00:00:00.001 Started by upstream project "autotest-per-patch" build number 121010 00:00:00.001 originally caused by: 00:00:00.001 Started by user sys_sgci 00:00:00.097 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.098 The recommended git tool is: git 00:00:00.098 using credential 00000000-0000-0000-0000-000000000002 00:00:00.099 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.150 Fetching changes from the remote Git repository 00:00:00.152 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.221 Using shallow fetch with depth 1 00:00:00.221 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.221 > git --version # timeout=10 00:00:00.240 > git --version # 'git version 2.39.2' 00:00:00.240 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.241 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.241 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.313 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.323 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.334 Checking out Revision 6e1fadd1eee50389429f9abb33dde5face8ca717 (FETCH_HEAD) 00:00:06.334 > git config core.sparsecheckout # timeout=10 00:00:06.345 > git read-tree -mu HEAD # timeout=10 00:00:06.361 > git checkout -f 6e1fadd1eee50389429f9abb33dde5face8ca717 # timeout=5 00:00:06.378 Commit message: "pool: attach build logs for failed merge builds" 00:00:06.378 > git rev-list --no-walk 6e1fadd1eee50389429f9abb33dde5face8ca717 # timeout=10 00:00:06.478 [Pipeline] Start of Pipeline 00:00:06.490 [Pipeline] library 00:00:06.491 Loading library shm_lib@master 00:00:06.491 Library shm_lib@master is cached. Copying from home. 00:00:06.508 [Pipeline] node 00:00:06.518 Running on WFP35 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:06.520 [Pipeline] { 00:00:06.530 [Pipeline] catchError 00:00:06.532 [Pipeline] { 00:00:06.544 [Pipeline] wrap 00:00:06.560 [Pipeline] { 00:00:06.588 [Pipeline] stage 00:00:06.591 [Pipeline] { (Prologue) 00:00:06.786 [Pipeline] sh 00:00:07.071 + logger -p user.info -t JENKINS-CI 00:00:07.091 [Pipeline] echo 00:00:07.093 Node: WFP35 00:00:07.100 [Pipeline] sh 00:00:07.400 [Pipeline] setCustomBuildProperty 00:00:07.412 [Pipeline] echo 00:00:07.414 Cleanup processes 00:00:07.419 [Pipeline] sh 00:00:07.701 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.701 2778299 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.716 [Pipeline] sh 00:00:08.001 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:08.001 ++ grep -v 'sudo pgrep' 00:00:08.001 ++ awk '{print $1}' 00:00:08.001 + sudo kill -9 00:00:08.001 + true 00:00:08.017 [Pipeline] cleanWs 00:00:08.029 [WS-CLEANUP] Deleting project workspace... 00:00:08.029 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.035 [WS-CLEANUP] done 00:00:08.041 [Pipeline] setCustomBuildProperty 00:00:08.056 [Pipeline] sh 00:00:08.338 + sudo git config --global --replace-all safe.directory '*' 00:00:08.420 [Pipeline] nodesByLabel 00:00:08.422 Found a total of 1 nodes with the 'sorcerer' label 00:00:08.431 [Pipeline] httpRequest 00:00:08.435 HttpMethod: GET 00:00:08.436 URL: http://10.211.164.96/packages/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:08.439 Sending request to url: http://10.211.164.96/packages/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:08.442 Response Code: HTTP/1.1 200 OK 00:00:08.443 Success: Status code 200 is in the accepted range: 200,404 00:00:08.443 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:09.247 [Pipeline] sh 00:00:09.562 + tar --no-same-owner -xf jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:09.584 [Pipeline] httpRequest 00:00:09.590 HttpMethod: GET 00:00:09.591 URL: http://10.211.164.96/packages/spdk_5c8d451f1a33f46d3d4261563c310dc4efcca339.tar.gz 00:00:09.593 Sending request to url: http://10.211.164.96/packages/spdk_5c8d451f1a33f46d3d4261563c310dc4efcca339.tar.gz 00:00:09.605 Response Code: HTTP/1.1 200 OK 00:00:09.606 Success: Status code 200 is in the accepted range: 200,404 00:00:09.607 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_5c8d451f1a33f46d3d4261563c310dc4efcca339.tar.gz 00:00:39.598 [Pipeline] sh 00:00:39.883 + tar --no-same-owner -xf spdk_5c8d451f1a33f46d3d4261563c310dc4efcca339.tar.gz 00:00:42.431 [Pipeline] sh 00:00:42.714 + git -C spdk log --oneline -n5 00:00:42.714 5c8d451f1 app/trace: emit owner descriptions 00:00:42.714 aaaef7578 trace: rename trace_event's poller_id to owner_id 00:00:42.714 98cccbebd trace: add concept of "owner" to trace files 00:00:42.714 bf2cbb6d8 trace: rename "per_lcore_history" to just "data" 00:00:42.714 035bc63a4 trace: add trace_flags_fini() 00:00:42.727 [Pipeline] } 00:00:42.745 [Pipeline] // stage 00:00:42.754 [Pipeline] stage 00:00:42.757 [Pipeline] { (Prepare) 00:00:42.777 [Pipeline] writeFile 00:00:42.793 [Pipeline] sh 00:00:43.075 + logger -p user.info -t JENKINS-CI 00:00:43.088 [Pipeline] sh 00:00:43.382 + logger -p user.info -t JENKINS-CI 00:00:43.411 [Pipeline] sh 00:00:43.689 + cat autorun-spdk.conf 00:00:43.689 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:43.689 SPDK_TEST_NVMF=1 00:00:43.689 SPDK_TEST_NVME_CLI=1 00:00:43.689 SPDK_TEST_NVMF_NICS=mlx5 00:00:43.689 SPDK_RUN_UBSAN=1 00:00:43.689 NET_TYPE=phy 00:00:43.696 RUN_NIGHTLY=0 00:00:43.700 [Pipeline] readFile 00:00:43.722 [Pipeline] withEnv 00:00:43.724 [Pipeline] { 00:00:43.737 [Pipeline] sh 00:00:44.023 + set -ex 00:00:44.023 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:00:44.023 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:44.023 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:44.023 ++ SPDK_TEST_NVMF=1 00:00:44.023 ++ SPDK_TEST_NVME_CLI=1 00:00:44.023 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:44.023 ++ SPDK_RUN_UBSAN=1 00:00:44.023 ++ NET_TYPE=phy 00:00:44.023 ++ RUN_NIGHTLY=0 00:00:44.023 + case $SPDK_TEST_NVMF_NICS in 00:00:44.023 + DRIVERS=mlx5_ib 00:00:44.023 + [[ -n mlx5_ib ]] 00:00:44.023 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:44.023 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:50.588 rmmod: ERROR: Module irdma is not currently loaded 00:00:50.588 rmmod: ERROR: Module i40iw is not currently loaded 00:00:50.588 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:50.588 + true 00:00:50.588 + for D in $DRIVERS 00:00:50.588 + sudo modprobe mlx5_ib 00:00:50.588 + exit 0 00:00:50.598 [Pipeline] } 00:00:50.613 [Pipeline] // withEnv 00:00:50.618 [Pipeline] } 00:00:50.639 [Pipeline] // stage 00:00:50.649 [Pipeline] catchError 00:00:50.651 [Pipeline] { 00:00:50.665 [Pipeline] timeout 00:00:50.665 Timeout set to expire in 40 min 00:00:50.666 [Pipeline] { 00:00:50.681 [Pipeline] stage 00:00:50.683 [Pipeline] { (Tests) 00:00:50.701 [Pipeline] sh 00:00:50.985 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:00:50.985 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:00:50.985 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:00:50.985 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:00:50.985 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:50.985 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:00:50.985 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:00:50.985 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:50.985 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:00:50.985 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:50.985 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:00:50.985 + source /etc/os-release 00:00:50.985 ++ NAME='Fedora Linux' 00:00:50.985 ++ VERSION='38 (Cloud Edition)' 00:00:50.985 ++ ID=fedora 00:00:50.985 ++ VERSION_ID=38 00:00:50.985 ++ VERSION_CODENAME= 00:00:50.985 ++ PLATFORM_ID=platform:f38 00:00:50.985 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:50.985 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:50.985 ++ LOGO=fedora-logo-icon 00:00:50.985 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:50.985 ++ HOME_URL=https://fedoraproject.org/ 00:00:50.985 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:50.985 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:50.985 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:50.985 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:50.985 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:50.985 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:50.985 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:50.985 ++ SUPPORT_END=2024-05-14 00:00:50.985 ++ VARIANT='Cloud Edition' 00:00:50.985 ++ VARIANT_ID=cloud 00:00:50.985 + uname -a 00:00:50.985 Linux spdk-wfp-35 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:50.985 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:00:54.284 Hugepages 00:00:54.284 node hugesize free / total 00:00:54.284 node0 1048576kB 0 / 0 00:00:54.284 node0 2048kB 0 / 0 00:00:54.284 node1 1048576kB 0 / 0 00:00:54.284 node1 2048kB 0 / 0 00:00:54.284 00:00:54.284 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:54.284 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:00:54.284 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:00:54.284 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:00:54.284 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:00:54.284 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:00:54.284 + rm -f /tmp/spdk-ld-path 00:00:54.284 + source autorun-spdk.conf 00:00:54.284 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:54.284 ++ SPDK_TEST_NVMF=1 00:00:54.284 ++ SPDK_TEST_NVME_CLI=1 00:00:54.284 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:54.284 ++ SPDK_RUN_UBSAN=1 00:00:54.284 ++ NET_TYPE=phy 00:00:54.284 ++ RUN_NIGHTLY=0 00:00:54.284 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:54.284 + [[ -n '' ]] 00:00:54.284 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:54.284 + for M in /var/spdk/build-*-manifest.txt 00:00:54.284 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:54.284 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:54.284 + for M in /var/spdk/build-*-manifest.txt 00:00:54.284 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:54.284 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:54.284 ++ uname 00:00:54.284 + [[ Linux == \L\i\n\u\x ]] 00:00:54.284 + sudo dmesg -T 00:00:54.284 + sudo dmesg --clear 00:00:54.284 + dmesg_pid=2779170 00:00:54.284 + [[ Fedora Linux == FreeBSD ]] 00:00:54.284 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:54.284 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:54.284 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:54.284 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:54.284 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:54.284 + [[ -x /usr/src/fio-static/fio ]] 00:00:54.284 + export FIO_BIN=/usr/src/fio-static/fio 00:00:54.284 + FIO_BIN=/usr/src/fio-static/fio 00:00:54.284 + sudo dmesg -Tw 00:00:54.284 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:54.284 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:54.284 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:54.284 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:54.284 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:54.284 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:54.284 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:54.284 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:54.284 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:54.284 Test configuration: 00:00:54.284 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:54.284 SPDK_TEST_NVMF=1 00:00:54.284 SPDK_TEST_NVME_CLI=1 00:00:54.284 SPDK_TEST_NVMF_NICS=mlx5 00:00:54.284 SPDK_RUN_UBSAN=1 00:00:54.284 NET_TYPE=phy 00:00:54.284 RUN_NIGHTLY=0 19:07:41 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:00:54.284 19:07:41 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:54.284 19:07:41 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:54.284 19:07:41 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:54.284 19:07:41 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.284 19:07:41 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.284 19:07:41 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.284 19:07:41 -- paths/export.sh@5 -- $ export PATH 00:00:54.284 19:07:41 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:54.284 19:07:41 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:00:54.284 19:07:41 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:54.284 19:07:41 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713978461.XXXXXX 00:00:54.284 19:07:41 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713978461.6BbzPw 00:00:54.284 19:07:41 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:54.284 19:07:41 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:54.284 19:07:41 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:00:54.284 19:07:41 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:54.284 19:07:41 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:54.284 19:07:41 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:54.284 19:07:41 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:00:54.284 19:07:41 -- common/autotest_common.sh@10 -- $ set +x 00:00:54.284 19:07:41 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:54.284 19:07:41 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:00:54.284 19:07:41 -- pm/common@17 -- $ local monitor 00:00:54.284 19:07:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:54.284 19:07:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2779204 00:00:54.284 19:07:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:54.284 19:07:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2779206 00:00:54.284 19:07:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:54.284 19:07:41 -- pm/common@21 -- $ date +%s 00:00:54.284 19:07:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2779208 00:00:54.284 19:07:41 -- pm/common@21 -- $ date +%s 00:00:54.284 19:07:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:54.284 19:07:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=2779211 00:00:54.284 19:07:41 -- pm/common@26 -- $ sleep 1 00:00:54.284 19:07:41 -- pm/common@21 -- $ date +%s 00:00:54.284 19:07:41 -- pm/common@21 -- $ date +%s 00:00:54.284 19:07:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713978461 00:00:54.284 19:07:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713978461 00:00:54.284 19:07:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713978461 00:00:54.284 19:07:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713978461 00:00:54.284 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713978461_collect-cpu-load.pm.log 00:00:54.284 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713978461_collect-vmstat.pm.log 00:00:54.284 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713978461_collect-bmc-pm.bmc.pm.log 00:00:54.284 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713978461_collect-cpu-temp.pm.log 00:00:55.287 19:07:42 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:00:55.287 19:07:42 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:55.287 19:07:42 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:55.287 19:07:42 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:55.287 19:07:42 -- spdk/autobuild.sh@16 -- $ date -u 00:00:55.287 Wed Apr 24 05:07:42 PM UTC 2024 00:00:55.287 19:07:42 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:55.287 v24.05-pre-442-g5c8d451f1 00:00:55.287 19:07:42 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:55.287 19:07:42 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:55.287 19:07:42 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:55.287 19:07:42 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:55.287 19:07:42 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:55.287 19:07:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:55.287 ************************************ 00:00:55.287 START TEST ubsan 00:00:55.287 ************************************ 00:00:55.287 19:07:42 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:00:55.287 using ubsan 00:00:55.287 00:00:55.287 real 0m0.001s 00:00:55.287 user 0m0.000s 00:00:55.287 sys 0m0.000s 00:00:55.287 19:07:42 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:00:55.287 19:07:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:55.287 ************************************ 00:00:55.287 END TEST ubsan 00:00:55.287 ************************************ 00:00:55.287 19:07:42 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:55.287 19:07:42 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:55.287 19:07:42 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:55.287 19:07:42 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:55.546 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:00:55.546 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:00:55.804 Using 'verbs' RDMA provider 00:01:08.947 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:23.905 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:23.905 Creating mk/config.mk...done. 00:01:23.905 Creating mk/cc.flags.mk...done. 00:01:23.905 Type 'make' to build. 00:01:23.905 19:08:09 -- spdk/autobuild.sh@69 -- $ run_test make make -j72 00:01:23.905 19:08:09 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:23.905 19:08:09 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:23.905 19:08:09 -- common/autotest_common.sh@10 -- $ set +x 00:01:23.905 ************************************ 00:01:23.905 START TEST make 00:01:23.905 ************************************ 00:01:23.905 19:08:09 -- common/autotest_common.sh@1111 -- $ make -j72 00:01:23.905 make[1]: Nothing to be done for 'all'. 00:01:32.039 The Meson build system 00:01:32.039 Version: 1.3.1 00:01:32.039 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:01:32.039 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:01:32.039 Build type: native build 00:01:32.039 Program cat found: YES (/usr/bin/cat) 00:01:32.039 Project name: DPDK 00:01:32.039 Project version: 23.11.0 00:01:32.039 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:32.039 C linker for the host machine: cc ld.bfd 2.39-16 00:01:32.039 Host machine cpu family: x86_64 00:01:32.039 Host machine cpu: x86_64 00:01:32.039 Message: ## Building in Developer Mode ## 00:01:32.039 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:32.039 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:32.039 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:32.039 Program python3 found: YES (/usr/bin/python3) 00:01:32.039 Program cat found: YES (/usr/bin/cat) 00:01:32.039 Compiler for C supports arguments -march=native: YES 00:01:32.039 Checking for size of "void *" : 8 00:01:32.039 Checking for size of "void *" : 8 (cached) 00:01:32.039 Library m found: YES 00:01:32.039 Library numa found: YES 00:01:32.039 Has header "numaif.h" : YES 00:01:32.039 Library fdt found: NO 00:01:32.039 Library execinfo found: NO 00:01:32.039 Has header "execinfo.h" : YES 00:01:32.039 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:32.039 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:32.039 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:32.039 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:32.039 Run-time dependency openssl found: YES 3.0.9 00:01:32.039 Run-time dependency libpcap found: YES 1.10.4 00:01:32.039 Has header "pcap.h" with dependency libpcap: YES 00:01:32.039 Compiler for C supports arguments -Wcast-qual: YES 00:01:32.039 Compiler for C supports arguments -Wdeprecated: YES 00:01:32.039 Compiler for C supports arguments -Wformat: YES 00:01:32.039 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:32.039 Compiler for C supports arguments -Wformat-security: NO 00:01:32.039 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:32.039 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:32.039 Compiler for C supports arguments -Wnested-externs: YES 00:01:32.039 Compiler for C supports arguments -Wold-style-definition: YES 00:01:32.039 Compiler for C supports arguments -Wpointer-arith: YES 00:01:32.039 Compiler for C supports arguments -Wsign-compare: YES 00:01:32.039 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:32.039 Compiler for C supports arguments -Wundef: YES 00:01:32.039 Compiler for C supports arguments -Wwrite-strings: YES 00:01:32.039 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:32.039 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:32.039 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:32.039 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:32.039 Program objdump found: YES (/usr/bin/objdump) 00:01:32.039 Compiler for C supports arguments -mavx512f: YES 00:01:32.039 Checking if "AVX512 checking" compiles: YES 00:01:32.039 Fetching value of define "__SSE4_2__" : 1 00:01:32.039 Fetching value of define "__AES__" : 1 00:01:32.039 Fetching value of define "__AVX__" : 1 00:01:32.039 Fetching value of define "__AVX2__" : 1 00:01:32.039 Fetching value of define "__AVX512BW__" : 1 00:01:32.039 Fetching value of define "__AVX512CD__" : 1 00:01:32.039 Fetching value of define "__AVX512DQ__" : 1 00:01:32.039 Fetching value of define "__AVX512F__" : 1 00:01:32.039 Fetching value of define "__AVX512VL__" : 1 00:01:32.039 Fetching value of define "__PCLMUL__" : 1 00:01:32.039 Fetching value of define "__RDRND__" : 1 00:01:32.039 Fetching value of define "__RDSEED__" : 1 00:01:32.039 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:32.039 Fetching value of define "__znver1__" : (undefined) 00:01:32.039 Fetching value of define "__znver2__" : (undefined) 00:01:32.039 Fetching value of define "__znver3__" : (undefined) 00:01:32.039 Fetching value of define "__znver4__" : (undefined) 00:01:32.039 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:32.039 Message: lib/log: Defining dependency "log" 00:01:32.039 Message: lib/kvargs: Defining dependency "kvargs" 00:01:32.039 Message: lib/telemetry: Defining dependency "telemetry" 00:01:32.039 Checking for function "getentropy" : NO 00:01:32.039 Message: lib/eal: Defining dependency "eal" 00:01:32.039 Message: lib/ring: Defining dependency "ring" 00:01:32.039 Message: lib/rcu: Defining dependency "rcu" 00:01:32.039 Message: lib/mempool: Defining dependency "mempool" 00:01:32.039 Message: lib/mbuf: Defining dependency "mbuf" 00:01:32.039 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:32.039 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:32.039 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:32.039 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:32.039 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:32.040 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:32.040 Compiler for C supports arguments -mpclmul: YES 00:01:32.040 Compiler for C supports arguments -maes: YES 00:01:32.040 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:32.040 Compiler for C supports arguments -mavx512bw: YES 00:01:32.040 Compiler for C supports arguments -mavx512dq: YES 00:01:32.040 Compiler for C supports arguments -mavx512vl: YES 00:01:32.040 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:32.040 Compiler for C supports arguments -mavx2: YES 00:01:32.040 Compiler for C supports arguments -mavx: YES 00:01:32.040 Message: lib/net: Defining dependency "net" 00:01:32.040 Message: lib/meter: Defining dependency "meter" 00:01:32.040 Message: lib/ethdev: Defining dependency "ethdev" 00:01:32.040 Message: lib/pci: Defining dependency "pci" 00:01:32.040 Message: lib/cmdline: Defining dependency "cmdline" 00:01:32.040 Message: lib/hash: Defining dependency "hash" 00:01:32.040 Message: lib/timer: Defining dependency "timer" 00:01:32.040 Message: lib/compressdev: Defining dependency "compressdev" 00:01:32.040 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:32.040 Message: lib/dmadev: Defining dependency "dmadev" 00:01:32.040 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:32.040 Message: lib/power: Defining dependency "power" 00:01:32.040 Message: lib/reorder: Defining dependency "reorder" 00:01:32.040 Message: lib/security: Defining dependency "security" 00:01:32.040 Has header "linux/userfaultfd.h" : YES 00:01:32.040 Has header "linux/vduse.h" : YES 00:01:32.040 Message: lib/vhost: Defining dependency "vhost" 00:01:32.040 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:32.040 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:32.040 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:32.040 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:32.040 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:32.040 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:32.040 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:32.040 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:32.040 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:32.040 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:32.040 Program doxygen found: YES (/usr/bin/doxygen) 00:01:32.040 Configuring doxy-api-html.conf using configuration 00:01:32.040 Configuring doxy-api-man.conf using configuration 00:01:32.040 Program mandb found: YES (/usr/bin/mandb) 00:01:32.040 Program sphinx-build found: NO 00:01:32.040 Configuring rte_build_config.h using configuration 00:01:32.040 Message: 00:01:32.040 ================= 00:01:32.040 Applications Enabled 00:01:32.040 ================= 00:01:32.040 00:01:32.040 apps: 00:01:32.040 00:01:32.040 00:01:32.040 Message: 00:01:32.040 ================= 00:01:32.040 Libraries Enabled 00:01:32.040 ================= 00:01:32.040 00:01:32.040 libs: 00:01:32.040 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:32.040 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:32.040 cryptodev, dmadev, power, reorder, security, vhost, 00:01:32.040 00:01:32.040 Message: 00:01:32.040 =============== 00:01:32.040 Drivers Enabled 00:01:32.040 =============== 00:01:32.040 00:01:32.040 common: 00:01:32.040 00:01:32.040 bus: 00:01:32.040 pci, vdev, 00:01:32.040 mempool: 00:01:32.040 ring, 00:01:32.040 dma: 00:01:32.040 00:01:32.040 net: 00:01:32.040 00:01:32.040 crypto: 00:01:32.040 00:01:32.040 compress: 00:01:32.040 00:01:32.040 vdpa: 00:01:32.040 00:01:32.040 00:01:32.040 Message: 00:01:32.040 ================= 00:01:32.040 Content Skipped 00:01:32.040 ================= 00:01:32.040 00:01:32.040 apps: 00:01:32.040 dumpcap: explicitly disabled via build config 00:01:32.040 graph: explicitly disabled via build config 00:01:32.040 pdump: explicitly disabled via build config 00:01:32.040 proc-info: explicitly disabled via build config 00:01:32.040 test-acl: explicitly disabled via build config 00:01:32.040 test-bbdev: explicitly disabled via build config 00:01:32.040 test-cmdline: explicitly disabled via build config 00:01:32.040 test-compress-perf: explicitly disabled via build config 00:01:32.040 test-crypto-perf: explicitly disabled via build config 00:01:32.040 test-dma-perf: explicitly disabled via build config 00:01:32.040 test-eventdev: explicitly disabled via build config 00:01:32.040 test-fib: explicitly disabled via build config 00:01:32.040 test-flow-perf: explicitly disabled via build config 00:01:32.040 test-gpudev: explicitly disabled via build config 00:01:32.040 test-mldev: explicitly disabled via build config 00:01:32.040 test-pipeline: explicitly disabled via build config 00:01:32.040 test-pmd: explicitly disabled via build config 00:01:32.040 test-regex: explicitly disabled via build config 00:01:32.040 test-sad: explicitly disabled via build config 00:01:32.040 test-security-perf: explicitly disabled via build config 00:01:32.040 00:01:32.040 libs: 00:01:32.040 metrics: explicitly disabled via build config 00:01:32.040 acl: explicitly disabled via build config 00:01:32.040 bbdev: explicitly disabled via build config 00:01:32.040 bitratestats: explicitly disabled via build config 00:01:32.040 bpf: explicitly disabled via build config 00:01:32.040 cfgfile: explicitly disabled via build config 00:01:32.040 distributor: explicitly disabled via build config 00:01:32.040 efd: explicitly disabled via build config 00:01:32.040 eventdev: explicitly disabled via build config 00:01:32.040 dispatcher: explicitly disabled via build config 00:01:32.040 gpudev: explicitly disabled via build config 00:01:32.040 gro: explicitly disabled via build config 00:01:32.040 gso: explicitly disabled via build config 00:01:32.040 ip_frag: explicitly disabled via build config 00:01:32.040 jobstats: explicitly disabled via build config 00:01:32.040 latencystats: explicitly disabled via build config 00:01:32.040 lpm: explicitly disabled via build config 00:01:32.040 member: explicitly disabled via build config 00:01:32.040 pcapng: explicitly disabled via build config 00:01:32.040 rawdev: explicitly disabled via build config 00:01:32.040 regexdev: explicitly disabled via build config 00:01:32.040 mldev: explicitly disabled via build config 00:01:32.040 rib: explicitly disabled via build config 00:01:32.040 sched: explicitly disabled via build config 00:01:32.040 stack: explicitly disabled via build config 00:01:32.040 ipsec: explicitly disabled via build config 00:01:32.040 pdcp: explicitly disabled via build config 00:01:32.040 fib: explicitly disabled via build config 00:01:32.040 port: explicitly disabled via build config 00:01:32.040 pdump: explicitly disabled via build config 00:01:32.040 table: explicitly disabled via build config 00:01:32.040 pipeline: explicitly disabled via build config 00:01:32.040 graph: explicitly disabled via build config 00:01:32.040 node: explicitly disabled via build config 00:01:32.040 00:01:32.040 drivers: 00:01:32.040 common/cpt: not in enabled drivers build config 00:01:32.040 common/dpaax: not in enabled drivers build config 00:01:32.040 common/iavf: not in enabled drivers build config 00:01:32.040 common/idpf: not in enabled drivers build config 00:01:32.040 common/mvep: not in enabled drivers build config 00:01:32.040 common/octeontx: not in enabled drivers build config 00:01:32.040 bus/auxiliary: not in enabled drivers build config 00:01:32.040 bus/cdx: not in enabled drivers build config 00:01:32.040 bus/dpaa: not in enabled drivers build config 00:01:32.040 bus/fslmc: not in enabled drivers build config 00:01:32.040 bus/ifpga: not in enabled drivers build config 00:01:32.040 bus/platform: not in enabled drivers build config 00:01:32.040 bus/vmbus: not in enabled drivers build config 00:01:32.041 common/cnxk: not in enabled drivers build config 00:01:32.041 common/mlx5: not in enabled drivers build config 00:01:32.041 common/nfp: not in enabled drivers build config 00:01:32.041 common/qat: not in enabled drivers build config 00:01:32.041 common/sfc_efx: not in enabled drivers build config 00:01:32.041 mempool/bucket: not in enabled drivers build config 00:01:32.041 mempool/cnxk: not in enabled drivers build config 00:01:32.041 mempool/dpaa: not in enabled drivers build config 00:01:32.041 mempool/dpaa2: not in enabled drivers build config 00:01:32.041 mempool/octeontx: not in enabled drivers build config 00:01:32.041 mempool/stack: not in enabled drivers build config 00:01:32.041 dma/cnxk: not in enabled drivers build config 00:01:32.041 dma/dpaa: not in enabled drivers build config 00:01:32.041 dma/dpaa2: not in enabled drivers build config 00:01:32.041 dma/hisilicon: not in enabled drivers build config 00:01:32.041 dma/idxd: not in enabled drivers build config 00:01:32.041 dma/ioat: not in enabled drivers build config 00:01:32.041 dma/skeleton: not in enabled drivers build config 00:01:32.041 net/af_packet: not in enabled drivers build config 00:01:32.041 net/af_xdp: not in enabled drivers build config 00:01:32.041 net/ark: not in enabled drivers build config 00:01:32.041 net/atlantic: not in enabled drivers build config 00:01:32.041 net/avp: not in enabled drivers build config 00:01:32.041 net/axgbe: not in enabled drivers build config 00:01:32.041 net/bnx2x: not in enabled drivers build config 00:01:32.041 net/bnxt: not in enabled drivers build config 00:01:32.041 net/bonding: not in enabled drivers build config 00:01:32.041 net/cnxk: not in enabled drivers build config 00:01:32.041 net/cpfl: not in enabled drivers build config 00:01:32.041 net/cxgbe: not in enabled drivers build config 00:01:32.041 net/dpaa: not in enabled drivers build config 00:01:32.041 net/dpaa2: not in enabled drivers build config 00:01:32.041 net/e1000: not in enabled drivers build config 00:01:32.041 net/ena: not in enabled drivers build config 00:01:32.041 net/enetc: not in enabled drivers build config 00:01:32.041 net/enetfec: not in enabled drivers build config 00:01:32.041 net/enic: not in enabled drivers build config 00:01:32.041 net/failsafe: not in enabled drivers build config 00:01:32.041 net/fm10k: not in enabled drivers build config 00:01:32.041 net/gve: not in enabled drivers build config 00:01:32.041 net/hinic: not in enabled drivers build config 00:01:32.041 net/hns3: not in enabled drivers build config 00:01:32.041 net/i40e: not in enabled drivers build config 00:01:32.041 net/iavf: not in enabled drivers build config 00:01:32.041 net/ice: not in enabled drivers build config 00:01:32.041 net/idpf: not in enabled drivers build config 00:01:32.041 net/igc: not in enabled drivers build config 00:01:32.041 net/ionic: not in enabled drivers build config 00:01:32.041 net/ipn3ke: not in enabled drivers build config 00:01:32.041 net/ixgbe: not in enabled drivers build config 00:01:32.041 net/mana: not in enabled drivers build config 00:01:32.041 net/memif: not in enabled drivers build config 00:01:32.041 net/mlx4: not in enabled drivers build config 00:01:32.041 net/mlx5: not in enabled drivers build config 00:01:32.041 net/mvneta: not in enabled drivers build config 00:01:32.041 net/mvpp2: not in enabled drivers build config 00:01:32.041 net/netvsc: not in enabled drivers build config 00:01:32.041 net/nfb: not in enabled drivers build config 00:01:32.041 net/nfp: not in enabled drivers build config 00:01:32.041 net/ngbe: not in enabled drivers build config 00:01:32.041 net/null: not in enabled drivers build config 00:01:32.041 net/octeontx: not in enabled drivers build config 00:01:32.041 net/octeon_ep: not in enabled drivers build config 00:01:32.041 net/pcap: not in enabled drivers build config 00:01:32.041 net/pfe: not in enabled drivers build config 00:01:32.041 net/qede: not in enabled drivers build config 00:01:32.041 net/ring: not in enabled drivers build config 00:01:32.041 net/sfc: not in enabled drivers build config 00:01:32.041 net/softnic: not in enabled drivers build config 00:01:32.041 net/tap: not in enabled drivers build config 00:01:32.041 net/thunderx: not in enabled drivers build config 00:01:32.041 net/txgbe: not in enabled drivers build config 00:01:32.041 net/vdev_netvsc: not in enabled drivers build config 00:01:32.041 net/vhost: not in enabled drivers build config 00:01:32.041 net/virtio: not in enabled drivers build config 00:01:32.041 net/vmxnet3: not in enabled drivers build config 00:01:32.041 raw/*: missing internal dependency, "rawdev" 00:01:32.041 crypto/armv8: not in enabled drivers build config 00:01:32.041 crypto/bcmfs: not in enabled drivers build config 00:01:32.041 crypto/caam_jr: not in enabled drivers build config 00:01:32.041 crypto/ccp: not in enabled drivers build config 00:01:32.041 crypto/cnxk: not in enabled drivers build config 00:01:32.041 crypto/dpaa_sec: not in enabled drivers build config 00:01:32.041 crypto/dpaa2_sec: not in enabled drivers build config 00:01:32.041 crypto/ipsec_mb: not in enabled drivers build config 00:01:32.041 crypto/mlx5: not in enabled drivers build config 00:01:32.041 crypto/mvsam: not in enabled drivers build config 00:01:32.041 crypto/nitrox: not in enabled drivers build config 00:01:32.041 crypto/null: not in enabled drivers build config 00:01:32.041 crypto/octeontx: not in enabled drivers build config 00:01:32.041 crypto/openssl: not in enabled drivers build config 00:01:32.041 crypto/scheduler: not in enabled drivers build config 00:01:32.041 crypto/uadk: not in enabled drivers build config 00:01:32.041 crypto/virtio: not in enabled drivers build config 00:01:32.041 compress/isal: not in enabled drivers build config 00:01:32.041 compress/mlx5: not in enabled drivers build config 00:01:32.041 compress/octeontx: not in enabled drivers build config 00:01:32.041 compress/zlib: not in enabled drivers build config 00:01:32.041 regex/*: missing internal dependency, "regexdev" 00:01:32.041 ml/*: missing internal dependency, "mldev" 00:01:32.041 vdpa/ifc: not in enabled drivers build config 00:01:32.041 vdpa/mlx5: not in enabled drivers build config 00:01:32.041 vdpa/nfp: not in enabled drivers build config 00:01:32.041 vdpa/sfc: not in enabled drivers build config 00:01:32.041 event/*: missing internal dependency, "eventdev" 00:01:32.041 baseband/*: missing internal dependency, "bbdev" 00:01:32.041 gpu/*: missing internal dependency, "gpudev" 00:01:32.041 00:01:32.041 00:01:32.041 Build targets in project: 85 00:01:32.041 00:01:32.041 DPDK 23.11.0 00:01:32.041 00:01:32.041 User defined options 00:01:32.041 buildtype : debug 00:01:32.041 default_library : shared 00:01:32.041 libdir : lib 00:01:32.041 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:32.041 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:32.041 c_link_args : 00:01:32.041 cpu_instruction_set: native 00:01:32.041 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:32.041 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:32.041 enable_docs : false 00:01:32.041 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:32.041 enable_kmods : false 00:01:32.041 tests : false 00:01:32.041 00:01:32.041 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:32.041 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:01:32.041 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:32.041 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:32.041 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:32.041 [4/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:32.041 [5/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:32.041 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:32.041 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:32.041 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:32.041 [9/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:32.041 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:32.042 [11/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:32.042 [12/265] Linking static target lib/librte_kvargs.a 00:01:32.042 [13/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:32.042 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:32.042 [15/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:32.042 [16/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:32.042 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:32.042 [18/265] Linking static target lib/librte_log.a 00:01:32.042 [19/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:32.042 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:32.042 [21/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:32.042 [22/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:32.042 [23/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:32.042 [24/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:32.042 [25/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:32.042 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:32.042 [27/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:32.042 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:32.042 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:32.042 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:32.042 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:32.042 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:32.042 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:32.042 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:32.042 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:32.042 [36/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:32.042 [37/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:32.042 [38/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:32.042 [39/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:32.042 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:32.042 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:32.042 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:32.042 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:32.042 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:32.042 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:32.042 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:32.042 [47/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:32.042 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:32.042 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:32.042 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:32.042 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:32.042 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:32.301 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:32.301 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:32.302 [55/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:32.302 [56/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.302 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:32.302 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:32.302 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:32.302 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:32.302 [61/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:32.302 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:32.302 [63/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:32.302 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:32.302 [65/265] Linking static target lib/librte_telemetry.a 00:01:32.302 [66/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:32.302 [67/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:32.302 [68/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:32.302 [69/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:32.302 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:32.302 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:32.302 [72/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:32.302 [73/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:32.302 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:32.302 [75/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:32.302 [76/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:32.302 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:32.302 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:32.302 [79/265] Linking static target lib/librte_ring.a 00:01:32.302 [80/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:32.302 [81/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:32.302 [82/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:32.302 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:32.302 [84/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:32.302 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:32.302 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:32.302 [87/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:32.302 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:32.302 [89/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:32.302 [90/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:32.302 [91/265] Linking static target lib/librte_pci.a 00:01:32.302 [92/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:32.302 [93/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:32.302 [94/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:32.302 [95/265] Linking static target lib/librte_meter.a 00:01:32.302 [96/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:32.302 [97/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:32.302 [98/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:32.302 [99/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:32.302 [100/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:32.302 [101/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:32.302 [102/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:32.302 [103/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:32.302 [104/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:32.302 [105/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:32.302 [106/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:32.302 [107/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:32.302 [108/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:32.302 [109/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:32.302 [110/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:32.302 [111/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:32.302 [112/265] Linking static target lib/librte_net.a 00:01:32.302 [113/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:32.302 [114/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:32.302 [115/265] Linking static target lib/librte_rcu.a 00:01:32.302 [116/265] Linking static target lib/librte_mempool.a 00:01:32.562 [117/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:32.562 [118/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:32.562 [119/265] Linking static target lib/librte_eal.a 00:01:32.562 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:32.562 [121/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.562 [122/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.562 [123/265] Linking target lib/librte_log.so.24.0 00:01:32.562 [124/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.562 [125/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.562 [126/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:32.562 [127/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:32.562 [128/265] Linking static target lib/librte_mbuf.a 00:01:32.562 [129/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:32.821 [130/265] Linking static target lib/librte_cmdline.a 00:01:32.821 [131/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:32.821 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:32.821 [133/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.821 [134/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:32.821 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:32.821 [136/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:32.821 [137/265] Linking static target lib/librte_timer.a 00:01:32.821 [138/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:32.821 [139/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:32.821 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:32.821 [141/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:32.821 [142/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.821 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:32.821 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:32.821 [145/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.821 [146/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:32.821 [147/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:32.821 [148/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:32.821 [149/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:32.821 [150/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:32.821 [151/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:32.821 [152/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:32.821 [153/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:32.821 [154/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:32.821 [155/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:32.821 [156/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:32.821 [157/265] Linking target lib/librte_telemetry.so.24.0 00:01:32.821 [158/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:32.821 [159/265] Linking target lib/librte_kvargs.so.24.0 00:01:32.821 [160/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:32.821 [161/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:32.821 [162/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:32.821 [163/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:32.821 [164/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:32.821 [165/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:32.821 [166/265] Linking static target lib/librte_compressdev.a 00:01:32.821 [167/265] Linking static target lib/librte_dmadev.a 00:01:32.821 [168/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:32.821 [169/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:32.821 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:32.821 [171/265] Linking static target lib/librte_power.a 00:01:32.821 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:32.821 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:32.821 [174/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:32.821 [175/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:32.821 [176/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:32.822 [177/265] Linking static target lib/librte_reorder.a 00:01:32.822 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:32.822 [179/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:32.822 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:32.822 [181/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:32.822 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:32.822 [183/265] Linking static target lib/librte_security.a 00:01:32.822 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:33.080 [185/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:33.080 [186/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:33.080 [187/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:33.080 [188/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:33.080 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:33.080 [190/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:33.080 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:33.080 [192/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:33.080 [193/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:33.080 [194/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:33.080 [195/265] Linking static target drivers/librte_bus_vdev.a 00:01:33.080 [196/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:33.080 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:33.080 [198/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:33.080 [199/265] Linking static target lib/librte_hash.a 00:01:33.080 [200/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:33.080 [201/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:33.080 [202/265] Linking static target drivers/librte_bus_pci.a 00:01:33.080 [203/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.080 [204/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.080 [205/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:33.338 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:33.338 [207/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:33.338 [208/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:33.338 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:33.338 [210/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:33.338 [211/265] Linking static target lib/librte_cryptodev.a 00:01:33.338 [212/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.339 [213/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.339 [214/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.339 [215/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.597 [216/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.597 [217/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.597 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:33.597 [219/265] Linking static target lib/librte_ethdev.a 00:01:33.597 [220/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:33.855 [221/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.855 [222/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.855 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.114 [224/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.680 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:34.680 [226/265] Linking static target lib/librte_vhost.a 00:01:35.616 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.993 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.556 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.492 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.492 [231/265] Linking target lib/librte_eal.so.24.0 00:01:44.751 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:44.751 [233/265] Linking target lib/librte_ring.so.24.0 00:01:44.751 [234/265] Linking target lib/librte_meter.so.24.0 00:01:44.751 [235/265] Linking target lib/librte_timer.so.24.0 00:01:44.751 [236/265] Linking target lib/librte_pci.so.24.0 00:01:44.751 [237/265] Linking target lib/librte_dmadev.so.24.0 00:01:44.751 [238/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:45.010 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:45.010 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:45.010 [241/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:45.010 [242/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:45.010 [243/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:45.010 [244/265] Linking target lib/librte_mempool.so.24.0 00:01:45.010 [245/265] Linking target lib/librte_rcu.so.24.0 00:01:45.010 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:45.010 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:45.010 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:45.010 [249/265] Linking target lib/librte_mbuf.so.24.0 00:01:45.010 [250/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:45.270 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:45.270 [252/265] Linking target lib/librte_reorder.so.24.0 00:01:45.270 [253/265] Linking target lib/librte_compressdev.so.24.0 00:01:45.270 [254/265] Linking target lib/librte_net.so.24.0 00:01:45.270 [255/265] Linking target lib/librte_cryptodev.so.24.0 00:01:45.528 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:45.528 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:45.528 [258/265] Linking target lib/librte_security.so.24.0 00:01:45.528 [259/265] Linking target lib/librte_hash.so.24.0 00:01:45.528 [260/265] Linking target lib/librte_cmdline.so.24.0 00:01:45.528 [261/265] Linking target lib/librte_ethdev.so.24.0 00:01:45.788 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:45.788 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:45.788 [264/265] Linking target lib/librte_power.so.24.0 00:01:45.788 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:45.788 INFO: autodetecting backend as ninja 00:01:45.788 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 72 00:01:46.724 CC lib/ut_mock/mock.o 00:01:46.724 CC lib/log/log_flags.o 00:01:46.724 CC lib/log/log.o 00:01:46.724 CC lib/log/log_deprecated.o 00:01:46.724 CC lib/ut/ut.o 00:01:46.983 LIB libspdk_ut_mock.a 00:01:46.983 SO libspdk_ut_mock.so.6.0 00:01:46.983 LIB libspdk_log.a 00:01:46.983 LIB libspdk_ut.a 00:01:46.983 SYMLINK libspdk_ut_mock.so 00:01:46.983 SO libspdk_log.so.7.0 00:01:46.983 SO libspdk_ut.so.2.0 00:01:46.983 SYMLINK libspdk_ut.so 00:01:46.983 SYMLINK libspdk_log.so 00:01:47.550 CC lib/dma/dma.o 00:01:47.550 CC lib/ioat/ioat.o 00:01:47.550 CXX lib/trace_parser/trace.o 00:01:47.550 CC lib/util/base64.o 00:01:47.550 CC lib/util/bit_array.o 00:01:47.550 CC lib/util/crc16.o 00:01:47.550 CC lib/util/cpuset.o 00:01:47.550 CC lib/util/crc32.o 00:01:47.550 CC lib/util/crc32c.o 00:01:47.550 CC lib/util/crc32_ieee.o 00:01:47.550 CC lib/util/dif.o 00:01:47.550 CC lib/util/fd.o 00:01:47.550 CC lib/util/crc64.o 00:01:47.550 CC lib/util/file.o 00:01:47.550 CC lib/util/hexlify.o 00:01:47.550 CC lib/util/iov.o 00:01:47.550 CC lib/util/math.o 00:01:47.550 CC lib/util/pipe.o 00:01:47.550 CC lib/util/strerror_tls.o 00:01:47.550 CC lib/util/string.o 00:01:47.550 CC lib/util/xor.o 00:01:47.550 CC lib/util/uuid.o 00:01:47.550 CC lib/util/fd_group.o 00:01:47.550 CC lib/util/zipf.o 00:01:47.550 CC lib/vfio_user/host/vfio_user.o 00:01:47.550 CC lib/vfio_user/host/vfio_user_pci.o 00:01:47.550 LIB libspdk_dma.a 00:01:47.550 SO libspdk_dma.so.4.0 00:01:47.808 LIB libspdk_ioat.a 00:01:47.808 SYMLINK libspdk_dma.so 00:01:47.808 SO libspdk_ioat.so.7.0 00:01:47.808 SYMLINK libspdk_ioat.so 00:01:47.808 LIB libspdk_vfio_user.a 00:01:47.808 SO libspdk_vfio_user.so.5.0 00:01:47.808 LIB libspdk_util.a 00:01:48.067 SYMLINK libspdk_vfio_user.so 00:01:48.067 SO libspdk_util.so.9.0 00:01:48.067 SYMLINK libspdk_util.so 00:01:48.067 LIB libspdk_trace_parser.a 00:01:48.326 SO libspdk_trace_parser.so.5.0 00:01:48.326 SYMLINK libspdk_trace_parser.so 00:01:48.326 CC lib/rdma/common.o 00:01:48.326 CC lib/conf/conf.o 00:01:48.326 CC lib/rdma/rdma_verbs.o 00:01:48.326 CC lib/json/json_parse.o 00:01:48.326 CC lib/json/json_util.o 00:01:48.326 CC lib/json/json_write.o 00:01:48.326 CC lib/env_dpdk/env.o 00:01:48.584 CC lib/env_dpdk/memory.o 00:01:48.584 CC lib/idxd/idxd.o 00:01:48.584 CC lib/idxd/idxd_user.o 00:01:48.584 CC lib/env_dpdk/pci.o 00:01:48.584 CC lib/env_dpdk/init.o 00:01:48.584 CC lib/env_dpdk/threads.o 00:01:48.584 CC lib/env_dpdk/pci_ioat.o 00:01:48.584 CC lib/env_dpdk/pci_virtio.o 00:01:48.584 CC lib/env_dpdk/pci_vmd.o 00:01:48.584 CC lib/env_dpdk/pci_idxd.o 00:01:48.584 CC lib/env_dpdk/pci_event.o 00:01:48.584 CC lib/env_dpdk/sigbus_handler.o 00:01:48.584 CC lib/env_dpdk/pci_dpdk.o 00:01:48.584 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:48.584 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:48.584 CC lib/vmd/vmd.o 00:01:48.584 CC lib/vmd/led.o 00:01:48.584 LIB libspdk_conf.a 00:01:48.584 SO libspdk_conf.so.6.0 00:01:48.584 LIB libspdk_rdma.a 00:01:48.843 LIB libspdk_json.a 00:01:48.843 SO libspdk_rdma.so.6.0 00:01:48.843 SYMLINK libspdk_conf.so 00:01:48.843 SO libspdk_json.so.6.0 00:01:48.843 SYMLINK libspdk_rdma.so 00:01:48.843 SYMLINK libspdk_json.so 00:01:48.843 LIB libspdk_idxd.a 00:01:48.843 SO libspdk_idxd.so.12.0 00:01:49.101 LIB libspdk_vmd.a 00:01:49.101 SO libspdk_vmd.so.6.0 00:01:49.101 SYMLINK libspdk_idxd.so 00:01:49.101 SYMLINK libspdk_vmd.so 00:01:49.101 CC lib/jsonrpc/jsonrpc_server.o 00:01:49.101 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:49.101 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:49.101 CC lib/jsonrpc/jsonrpc_client.o 00:01:49.360 LIB libspdk_jsonrpc.a 00:01:49.360 LIB libspdk_env_dpdk.a 00:01:49.360 SO libspdk_jsonrpc.so.6.0 00:01:49.619 SO libspdk_env_dpdk.so.14.0 00:01:49.619 SYMLINK libspdk_jsonrpc.so 00:01:49.619 SYMLINK libspdk_env_dpdk.so 00:01:49.878 CC lib/rpc/rpc.o 00:01:50.137 LIB libspdk_rpc.a 00:01:50.137 SO libspdk_rpc.so.6.0 00:01:50.137 SYMLINK libspdk_rpc.so 00:01:50.706 CC lib/keyring/keyring_rpc.o 00:01:50.706 CC lib/keyring/keyring.o 00:01:50.706 CC lib/trace/trace_rpc.o 00:01:50.706 CC lib/trace/trace.o 00:01:50.706 CC lib/trace/trace_flags.o 00:01:50.706 CC lib/notify/notify_rpc.o 00:01:50.706 CC lib/notify/notify.o 00:01:50.706 LIB libspdk_keyring.a 00:01:50.706 LIB libspdk_notify.a 00:01:50.706 SO libspdk_keyring.so.1.0 00:01:50.706 SO libspdk_notify.so.6.0 00:01:50.706 LIB libspdk_trace.a 00:01:50.706 SYMLINK libspdk_keyring.so 00:01:50.965 SO libspdk_trace.so.10.0 00:01:50.965 SYMLINK libspdk_notify.so 00:01:50.965 SYMLINK libspdk_trace.so 00:01:51.223 CC lib/thread/thread.o 00:01:51.223 CC lib/thread/iobuf.o 00:01:51.223 CC lib/sock/sock.o 00:01:51.223 CC lib/sock/sock_rpc.o 00:01:51.481 LIB libspdk_sock.a 00:01:51.739 SO libspdk_sock.so.9.0 00:01:51.739 SYMLINK libspdk_sock.so 00:01:51.997 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:51.997 CC lib/nvme/nvme_fabric.o 00:01:51.997 CC lib/nvme/nvme_ns_cmd.o 00:01:51.997 CC lib/nvme/nvme_ctrlr.o 00:01:51.997 CC lib/nvme/nvme_ns.o 00:01:51.997 CC lib/nvme/nvme_pcie_common.o 00:01:51.997 CC lib/nvme/nvme_pcie.o 00:01:51.997 CC lib/nvme/nvme.o 00:01:51.997 CC lib/nvme/nvme_qpair.o 00:01:51.997 CC lib/nvme/nvme_quirks.o 00:01:51.998 CC lib/nvme/nvme_transport.o 00:01:51.998 CC lib/nvme/nvme_discovery.o 00:01:51.998 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:51.998 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:51.998 CC lib/nvme/nvme_tcp.o 00:01:51.998 CC lib/nvme/nvme_opal.o 00:01:51.998 CC lib/nvme/nvme_io_msg.o 00:01:51.998 CC lib/nvme/nvme_poll_group.o 00:01:51.998 CC lib/nvme/nvme_zns.o 00:01:51.998 CC lib/nvme/nvme_auth.o 00:01:51.998 CC lib/nvme/nvme_stubs.o 00:01:51.998 CC lib/nvme/nvme_cuse.o 00:01:51.998 CC lib/nvme/nvme_rdma.o 00:01:52.255 LIB libspdk_thread.a 00:01:52.255 SO libspdk_thread.so.10.0 00:01:52.513 SYMLINK libspdk_thread.so 00:01:52.773 CC lib/blob/blobstore.o 00:01:52.773 CC lib/blob/request.o 00:01:52.773 CC lib/blob/zeroes.o 00:01:52.773 CC lib/blob/blob_bs_dev.o 00:01:52.773 CC lib/virtio/virtio.o 00:01:52.773 CC lib/virtio/virtio_vhost_user.o 00:01:52.773 CC lib/virtio/virtio_vfio_user.o 00:01:52.773 CC lib/virtio/virtio_pci.o 00:01:52.773 CC lib/accel/accel.o 00:01:52.773 CC lib/accel/accel_rpc.o 00:01:52.773 CC lib/accel/accel_sw.o 00:01:52.773 CC lib/init/json_config.o 00:01:52.773 CC lib/init/subsystem_rpc.o 00:01:52.773 CC lib/init/subsystem.o 00:01:52.773 CC lib/init/rpc.o 00:01:53.033 LIB libspdk_init.a 00:01:53.033 SO libspdk_init.so.5.0 00:01:53.033 LIB libspdk_virtio.a 00:01:53.033 SO libspdk_virtio.so.7.0 00:01:53.033 SYMLINK libspdk_init.so 00:01:53.033 SYMLINK libspdk_virtio.so 00:01:53.291 CC lib/event/reactor.o 00:01:53.291 CC lib/event/app.o 00:01:53.291 CC lib/event/app_rpc.o 00:01:53.291 CC lib/event/log_rpc.o 00:01:53.291 CC lib/event/scheduler_static.o 00:01:53.551 LIB libspdk_accel.a 00:01:53.551 SO libspdk_accel.so.15.0 00:01:53.551 SYMLINK libspdk_accel.so 00:01:53.822 LIB libspdk_event.a 00:01:53.822 LIB libspdk_nvme.a 00:01:53.822 SO libspdk_event.so.13.0 00:01:53.822 SYMLINK libspdk_event.so 00:01:53.822 SO libspdk_nvme.so.13.0 00:01:53.822 CC lib/bdev/bdev_rpc.o 00:01:53.822 CC lib/bdev/bdev.o 00:01:53.822 CC lib/bdev/bdev_zone.o 00:01:53.822 CC lib/bdev/part.o 00:01:53.822 CC lib/bdev/scsi_nvme.o 00:01:54.107 SYMLINK libspdk_nvme.so 00:01:54.686 LIB libspdk_blob.a 00:01:54.686 SO libspdk_blob.so.11.0 00:01:54.944 SYMLINK libspdk_blob.so 00:01:55.203 CC lib/blobfs/tree.o 00:01:55.203 CC lib/blobfs/blobfs.o 00:01:55.203 CC lib/lvol/lvol.o 00:01:55.769 LIB libspdk_bdev.a 00:01:55.769 SO libspdk_bdev.so.15.0 00:01:55.769 LIB libspdk_blobfs.a 00:01:55.769 SO libspdk_blobfs.so.10.0 00:01:55.769 LIB libspdk_lvol.a 00:01:55.769 SYMLINK libspdk_bdev.so 00:01:55.769 SO libspdk_lvol.so.10.0 00:01:56.028 SYMLINK libspdk_blobfs.so 00:01:56.028 SYMLINK libspdk_lvol.so 00:01:56.289 CC lib/nvmf/ctrlr_discovery.o 00:01:56.289 CC lib/nvmf/ctrlr.o 00:01:56.289 CC lib/ublk/ublk.o 00:01:56.289 CC lib/nvmf/ctrlr_bdev.o 00:01:56.289 CC lib/nvmf/subsystem.o 00:01:56.289 CC lib/nvmf/transport.o 00:01:56.289 CC lib/ublk/ublk_rpc.o 00:01:56.289 CC lib/nvmf/nvmf.o 00:01:56.289 CC lib/nvmf/nvmf_rpc.o 00:01:56.289 CC lib/nvmf/tcp.o 00:01:56.289 CC lib/nvmf/rdma.o 00:01:56.289 CC lib/nbd/nbd.o 00:01:56.289 CC lib/scsi/dev.o 00:01:56.289 CC lib/nbd/nbd_rpc.o 00:01:56.289 CC lib/scsi/lun.o 00:01:56.289 CC lib/scsi/port.o 00:01:56.289 CC lib/scsi/scsi.o 00:01:56.289 CC lib/scsi/scsi_rpc.o 00:01:56.289 CC lib/scsi/scsi_pr.o 00:01:56.289 CC lib/scsi/scsi_bdev.o 00:01:56.289 CC lib/scsi/task.o 00:01:56.289 CC lib/ftl/ftl_init.o 00:01:56.289 CC lib/ftl/ftl_core.o 00:01:56.289 CC lib/ftl/ftl_layout.o 00:01:56.289 CC lib/ftl/ftl_debug.o 00:01:56.289 CC lib/ftl/ftl_sb.o 00:01:56.289 CC lib/ftl/ftl_io.o 00:01:56.289 CC lib/ftl/ftl_l2p.o 00:01:56.289 CC lib/ftl/ftl_l2p_flat.o 00:01:56.289 CC lib/ftl/ftl_band_ops.o 00:01:56.289 CC lib/ftl/ftl_nv_cache.o 00:01:56.289 CC lib/ftl/ftl_rq.o 00:01:56.289 CC lib/ftl/ftl_band.o 00:01:56.289 CC lib/ftl/ftl_writer.o 00:01:56.289 CC lib/ftl/ftl_reloc.o 00:01:56.289 CC lib/ftl/ftl_l2p_cache.o 00:01:56.289 CC lib/ftl/ftl_p2l.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:56.289 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:56.289 CC lib/ftl/utils/ftl_conf.o 00:01:56.289 CC lib/ftl/utils/ftl_md.o 00:01:56.289 CC lib/ftl/utils/ftl_mempool.o 00:01:56.289 CC lib/ftl/utils/ftl_bitmap.o 00:01:56.289 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:56.289 CC lib/ftl/utils/ftl_property.o 00:01:56.289 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:56.289 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:56.289 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:56.289 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:56.289 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:56.289 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:56.289 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:56.289 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:56.289 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:56.289 CC lib/ftl/base/ftl_base_bdev.o 00:01:56.289 CC lib/ftl/base/ftl_base_dev.o 00:01:56.289 CC lib/ftl/ftl_trace.o 00:01:56.861 LIB libspdk_nbd.a 00:01:56.861 SO libspdk_nbd.so.7.0 00:01:56.861 SYMLINK libspdk_nbd.so 00:01:56.861 LIB libspdk_scsi.a 00:01:56.861 SO libspdk_scsi.so.9.0 00:01:56.861 LIB libspdk_ublk.a 00:01:57.120 SO libspdk_ublk.so.3.0 00:01:57.120 SYMLINK libspdk_scsi.so 00:01:57.120 SYMLINK libspdk_ublk.so 00:01:57.120 LIB libspdk_ftl.a 00:01:57.378 SO libspdk_ftl.so.9.0 00:01:57.378 CC lib/vhost/vhost_rpc.o 00:01:57.378 CC lib/vhost/vhost_scsi.o 00:01:57.378 CC lib/vhost/vhost.o 00:01:57.378 CC lib/vhost/vhost_blk.o 00:01:57.378 CC lib/vhost/rte_vhost_user.o 00:01:57.378 CC lib/iscsi/conn.o 00:01:57.378 CC lib/iscsi/param.o 00:01:57.378 CC lib/iscsi/init_grp.o 00:01:57.378 CC lib/iscsi/iscsi.o 00:01:57.378 CC lib/iscsi/md5.o 00:01:57.378 CC lib/iscsi/portal_grp.o 00:01:57.378 CC lib/iscsi/task.o 00:01:57.378 CC lib/iscsi/tgt_node.o 00:01:57.378 CC lib/iscsi/iscsi_subsystem.o 00:01:57.378 CC lib/iscsi/iscsi_rpc.o 00:01:57.636 SYMLINK libspdk_ftl.so 00:01:57.895 LIB libspdk_nvmf.a 00:01:58.153 SO libspdk_nvmf.so.18.0 00:01:58.153 SYMLINK libspdk_nvmf.so 00:01:58.153 LIB libspdk_vhost.a 00:01:58.153 SO libspdk_vhost.so.8.0 00:01:58.411 SYMLINK libspdk_vhost.so 00:01:58.411 LIB libspdk_iscsi.a 00:01:58.411 SO libspdk_iscsi.so.8.0 00:01:58.670 SYMLINK libspdk_iscsi.so 00:01:59.239 CC module/env_dpdk/env_dpdk_rpc.o 00:01:59.239 CC module/blob/bdev/blob_bdev.o 00:01:59.239 CC module/keyring/file/keyring.o 00:01:59.239 CC module/accel/dsa/accel_dsa.o 00:01:59.239 CC module/accel/dsa/accel_dsa_rpc.o 00:01:59.239 CC module/sock/posix/posix.o 00:01:59.239 CC module/keyring/file/keyring_rpc.o 00:01:59.239 LIB libspdk_env_dpdk_rpc.a 00:01:59.239 CC module/accel/error/accel_error.o 00:01:59.239 CC module/accel/error/accel_error_rpc.o 00:01:59.239 CC module/accel/ioat/accel_ioat_rpc.o 00:01:59.239 CC module/scheduler/gscheduler/gscheduler.o 00:01:59.239 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:59.239 CC module/accel/ioat/accel_ioat.o 00:01:59.239 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:59.239 CC module/accel/iaa/accel_iaa.o 00:01:59.239 CC module/accel/iaa/accel_iaa_rpc.o 00:01:59.239 SO libspdk_env_dpdk_rpc.so.6.0 00:01:59.239 SYMLINK libspdk_env_dpdk_rpc.so 00:01:59.498 LIB libspdk_keyring_file.a 00:01:59.498 LIB libspdk_scheduler_dpdk_governor.a 00:01:59.498 LIB libspdk_scheduler_gscheduler.a 00:01:59.498 LIB libspdk_accel_error.a 00:01:59.498 LIB libspdk_scheduler_dynamic.a 00:01:59.498 SO libspdk_keyring_file.so.1.0 00:01:59.498 SO libspdk_scheduler_dpdk_governor.so.4.0 00:01:59.498 SO libspdk_scheduler_gscheduler.so.4.0 00:01:59.498 SO libspdk_accel_error.so.2.0 00:01:59.498 LIB libspdk_blob_bdev.a 00:01:59.498 LIB libspdk_accel_ioat.a 00:01:59.498 LIB libspdk_accel_dsa.a 00:01:59.498 LIB libspdk_accel_iaa.a 00:01:59.498 SO libspdk_scheduler_dynamic.so.4.0 00:01:59.498 SO libspdk_blob_bdev.so.11.0 00:01:59.498 SYMLINK libspdk_scheduler_gscheduler.so 00:01:59.498 SO libspdk_accel_dsa.so.5.0 00:01:59.498 SO libspdk_accel_ioat.so.6.0 00:01:59.498 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:59.498 SO libspdk_accel_iaa.so.3.0 00:01:59.498 SYMLINK libspdk_keyring_file.so 00:01:59.498 SYMLINK libspdk_accel_error.so 00:01:59.498 SYMLINK libspdk_scheduler_dynamic.so 00:01:59.498 SYMLINK libspdk_blob_bdev.so 00:01:59.498 SYMLINK libspdk_accel_ioat.so 00:01:59.498 SYMLINK libspdk_accel_dsa.so 00:01:59.498 SYMLINK libspdk_accel_iaa.so 00:01:59.757 LIB libspdk_sock_posix.a 00:01:59.757 SO libspdk_sock_posix.so.6.0 00:02:00.015 SYMLINK libspdk_sock_posix.so 00:02:00.015 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:00.015 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:00.015 CC module/bdev/error/vbdev_error.o 00:02:00.015 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:00.015 CC module/bdev/error/vbdev_error_rpc.o 00:02:00.015 CC module/bdev/passthru/vbdev_passthru.o 00:02:00.015 CC module/bdev/malloc/bdev_malloc.o 00:02:00.015 CC module/bdev/lvol/vbdev_lvol.o 00:02:00.015 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:00.015 CC module/bdev/aio/bdev_aio.o 00:02:00.015 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:00.015 CC module/bdev/null/bdev_null.o 00:02:00.015 CC module/bdev/split/vbdev_split.o 00:02:00.015 CC module/bdev/aio/bdev_aio_rpc.o 00:02:00.015 CC module/bdev/null/bdev_null_rpc.o 00:02:00.015 CC module/bdev/split/vbdev_split_rpc.o 00:02:00.015 CC module/bdev/iscsi/bdev_iscsi.o 00:02:00.015 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:00.015 CC module/bdev/gpt/gpt.o 00:02:00.015 CC module/blobfs/bdev/blobfs_bdev.o 00:02:00.016 CC module/bdev/gpt/vbdev_gpt.o 00:02:00.016 CC module/bdev/nvme/bdev_nvme.o 00:02:00.016 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:00.016 CC module/bdev/raid/bdev_raid.o 00:02:00.016 CC module/bdev/nvme/bdev_mdns_client.o 00:02:00.016 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:00.016 CC module/bdev/delay/vbdev_delay.o 00:02:00.016 CC module/bdev/nvme/nvme_rpc.o 00:02:00.016 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:00.016 CC module/bdev/raid/bdev_raid_rpc.o 00:02:00.016 CC module/bdev/nvme/vbdev_opal.o 00:02:00.016 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:00.016 CC module/bdev/raid/bdev_raid_sb.o 00:02:00.016 CC module/bdev/raid/raid0.o 00:02:00.016 CC module/bdev/raid/concat.o 00:02:00.016 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:00.016 CC module/bdev/raid/raid1.o 00:02:00.016 CC module/bdev/ftl/bdev_ftl.o 00:02:00.016 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:00.016 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:00.016 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:00.016 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:00.274 LIB libspdk_bdev_split.a 00:02:00.274 LIB libspdk_bdev_error.a 00:02:00.274 LIB libspdk_bdev_null.a 00:02:00.274 LIB libspdk_bdev_gpt.a 00:02:00.274 LIB libspdk_blobfs_bdev.a 00:02:00.274 LIB libspdk_bdev_passthru.a 00:02:00.274 SO libspdk_bdev_split.so.6.0 00:02:00.274 SO libspdk_bdev_gpt.so.6.0 00:02:00.274 SO libspdk_bdev_null.so.6.0 00:02:00.274 SO libspdk_bdev_error.so.6.0 00:02:00.274 SO libspdk_blobfs_bdev.so.6.0 00:02:00.274 LIB libspdk_bdev_zone_block.a 00:02:00.274 LIB libspdk_bdev_ftl.a 00:02:00.274 SO libspdk_bdev_passthru.so.6.0 00:02:00.274 LIB libspdk_bdev_aio.a 00:02:00.274 SO libspdk_bdev_ftl.so.6.0 00:02:00.274 SO libspdk_bdev_zone_block.so.6.0 00:02:00.532 SYMLINK libspdk_bdev_split.so 00:02:00.532 SYMLINK libspdk_bdev_gpt.so 00:02:00.532 SYMLINK libspdk_blobfs_bdev.so 00:02:00.532 SYMLINK libspdk_bdev_null.so 00:02:00.532 SO libspdk_bdev_aio.so.6.0 00:02:00.532 LIB libspdk_bdev_delay.a 00:02:00.532 SYMLINK libspdk_bdev_error.so 00:02:00.532 SYMLINK libspdk_bdev_passthru.so 00:02:00.532 SYMLINK libspdk_bdev_zone_block.so 00:02:00.533 SO libspdk_bdev_delay.so.6.0 00:02:00.533 SYMLINK libspdk_bdev_ftl.so 00:02:00.533 SYMLINK libspdk_bdev_aio.so 00:02:00.533 LIB libspdk_bdev_iscsi.a 00:02:00.533 LIB libspdk_bdev_malloc.a 00:02:00.533 SYMLINK libspdk_bdev_delay.so 00:02:00.533 SO libspdk_bdev_iscsi.so.6.0 00:02:00.533 SO libspdk_bdev_malloc.so.6.0 00:02:00.533 LIB libspdk_bdev_lvol.a 00:02:00.533 LIB libspdk_bdev_virtio.a 00:02:00.533 SYMLINK libspdk_bdev_iscsi.so 00:02:00.533 SO libspdk_bdev_lvol.so.6.0 00:02:00.533 SYMLINK libspdk_bdev_malloc.so 00:02:00.792 SO libspdk_bdev_virtio.so.6.0 00:02:00.792 SYMLINK libspdk_bdev_lvol.so 00:02:00.792 SYMLINK libspdk_bdev_virtio.so 00:02:00.792 LIB libspdk_bdev_raid.a 00:02:00.792 SO libspdk_bdev_raid.so.6.0 00:02:01.051 SYMLINK libspdk_bdev_raid.so 00:02:01.619 LIB libspdk_bdev_nvme.a 00:02:01.619 SO libspdk_bdev_nvme.so.7.0 00:02:01.878 SYMLINK libspdk_bdev_nvme.so 00:02:02.446 CC module/event/subsystems/scheduler/scheduler.o 00:02:02.446 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:02.446 CC module/event/subsystems/iobuf/iobuf.o 00:02:02.446 CC module/event/subsystems/vmd/vmd.o 00:02:02.446 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:02.446 CC module/event/subsystems/sock/sock.o 00:02:02.446 CC module/event/subsystems/keyring/keyring.o 00:02:02.446 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:02.706 LIB libspdk_event_scheduler.a 00:02:02.706 LIB libspdk_event_sock.a 00:02:02.706 LIB libspdk_event_keyring.a 00:02:02.706 LIB libspdk_event_iobuf.a 00:02:02.706 LIB libspdk_event_vhost_blk.a 00:02:02.706 LIB libspdk_event_vmd.a 00:02:02.706 SO libspdk_event_scheduler.so.4.0 00:02:02.706 SO libspdk_event_keyring.so.1.0 00:02:02.706 SO libspdk_event_sock.so.5.0 00:02:02.706 SO libspdk_event_iobuf.so.3.0 00:02:02.706 SO libspdk_event_vhost_blk.so.3.0 00:02:02.706 SO libspdk_event_vmd.so.6.0 00:02:02.706 SYMLINK libspdk_event_scheduler.so 00:02:02.706 SYMLINK libspdk_event_keyring.so 00:02:02.706 SYMLINK libspdk_event_sock.so 00:02:02.706 SYMLINK libspdk_event_iobuf.so 00:02:02.706 SYMLINK libspdk_event_vhost_blk.so 00:02:02.706 SYMLINK libspdk_event_vmd.so 00:02:03.275 CC module/event/subsystems/accel/accel.o 00:02:03.275 LIB libspdk_event_accel.a 00:02:03.275 SO libspdk_event_accel.so.6.0 00:02:03.275 SYMLINK libspdk_event_accel.so 00:02:03.842 CC module/event/subsystems/bdev/bdev.o 00:02:03.842 LIB libspdk_event_bdev.a 00:02:03.842 SO libspdk_event_bdev.so.6.0 00:02:03.842 SYMLINK libspdk_event_bdev.so 00:02:04.409 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:04.409 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:04.409 CC module/event/subsystems/scsi/scsi.o 00:02:04.409 CC module/event/subsystems/ublk/ublk.o 00:02:04.409 CC module/event/subsystems/nbd/nbd.o 00:02:04.409 LIB libspdk_event_scsi.a 00:02:04.409 LIB libspdk_event_nbd.a 00:02:04.409 LIB libspdk_event_ublk.a 00:02:04.409 SO libspdk_event_scsi.so.6.0 00:02:04.409 SO libspdk_event_nbd.so.6.0 00:02:04.409 LIB libspdk_event_nvmf.a 00:02:04.409 SO libspdk_event_ublk.so.3.0 00:02:04.409 SYMLINK libspdk_event_scsi.so 00:02:04.409 SO libspdk_event_nvmf.so.6.0 00:02:04.409 SYMLINK libspdk_event_nbd.so 00:02:04.409 SYMLINK libspdk_event_ublk.so 00:02:04.668 SYMLINK libspdk_event_nvmf.so 00:02:04.927 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:04.927 CC module/event/subsystems/iscsi/iscsi.o 00:02:04.927 LIB libspdk_event_vhost_scsi.a 00:02:04.927 LIB libspdk_event_iscsi.a 00:02:04.927 SO libspdk_event_vhost_scsi.so.3.0 00:02:04.927 SO libspdk_event_iscsi.so.6.0 00:02:04.927 SYMLINK libspdk_event_vhost_scsi.so 00:02:05.186 SYMLINK libspdk_event_iscsi.so 00:02:05.186 SO libspdk.so.6.0 00:02:05.186 SYMLINK libspdk.so 00:02:05.445 CC app/trace_record/trace_record.o 00:02:05.706 CC app/spdk_lspci/spdk_lspci.o 00:02:05.706 CC app/spdk_top/spdk_top.o 00:02:05.706 CC app/spdk_nvme_identify/identify.o 00:02:05.706 CXX app/trace/trace.o 00:02:05.706 CC app/spdk_nvme_perf/perf.o 00:02:05.706 CC app/spdk_nvme_discover/discovery_aer.o 00:02:05.706 TEST_HEADER include/spdk/accel.h 00:02:05.706 TEST_HEADER include/spdk/accel_module.h 00:02:05.706 TEST_HEADER include/spdk/assert.h 00:02:05.706 TEST_HEADER include/spdk/barrier.h 00:02:05.706 TEST_HEADER include/spdk/base64.h 00:02:05.706 TEST_HEADER include/spdk/bdev_module.h 00:02:05.706 TEST_HEADER include/spdk/bdev.h 00:02:05.706 CC test/rpc_client/rpc_client_test.o 00:02:05.706 TEST_HEADER include/spdk/bdev_zone.h 00:02:05.706 TEST_HEADER include/spdk/bit_pool.h 00:02:05.706 TEST_HEADER include/spdk/bit_array.h 00:02:05.706 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:05.706 TEST_HEADER include/spdk/blob_bdev.h 00:02:05.706 TEST_HEADER include/spdk/blob.h 00:02:05.706 TEST_HEADER include/spdk/blobfs.h 00:02:05.706 TEST_HEADER include/spdk/conf.h 00:02:05.706 TEST_HEADER include/spdk/config.h 00:02:05.706 TEST_HEADER include/spdk/cpuset.h 00:02:05.706 TEST_HEADER include/spdk/crc16.h 00:02:05.706 TEST_HEADER include/spdk/crc32.h 00:02:05.706 TEST_HEADER include/spdk/dif.h 00:02:05.706 TEST_HEADER include/spdk/crc64.h 00:02:05.706 TEST_HEADER include/spdk/dma.h 00:02:05.706 TEST_HEADER include/spdk/endian.h 00:02:05.706 TEST_HEADER include/spdk/env_dpdk.h 00:02:05.706 TEST_HEADER include/spdk/env.h 00:02:05.706 TEST_HEADER include/spdk/event.h 00:02:05.706 CC app/nvmf_tgt/nvmf_main.o 00:02:05.706 TEST_HEADER include/spdk/fd_group.h 00:02:05.706 TEST_HEADER include/spdk/fd.h 00:02:05.706 TEST_HEADER include/spdk/file.h 00:02:05.706 TEST_HEADER include/spdk/ftl.h 00:02:05.706 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:05.706 TEST_HEADER include/spdk/gpt_spec.h 00:02:05.706 TEST_HEADER include/spdk/hexlify.h 00:02:05.706 TEST_HEADER include/spdk/histogram_data.h 00:02:05.706 CC app/spdk_dd/spdk_dd.o 00:02:05.706 TEST_HEADER include/spdk/idxd.h 00:02:05.706 TEST_HEADER include/spdk/idxd_spec.h 00:02:05.706 CC app/vhost/vhost.o 00:02:05.706 TEST_HEADER include/spdk/init.h 00:02:05.706 CC app/iscsi_tgt/iscsi_tgt.o 00:02:05.706 TEST_HEADER include/spdk/ioat.h 00:02:05.706 TEST_HEADER include/spdk/ioat_spec.h 00:02:05.706 TEST_HEADER include/spdk/iscsi_spec.h 00:02:05.706 TEST_HEADER include/spdk/json.h 00:02:05.706 TEST_HEADER include/spdk/jsonrpc.h 00:02:05.706 TEST_HEADER include/spdk/keyring.h 00:02:05.706 TEST_HEADER include/spdk/keyring_module.h 00:02:05.706 CC app/spdk_tgt/spdk_tgt.o 00:02:05.706 TEST_HEADER include/spdk/likely.h 00:02:05.706 TEST_HEADER include/spdk/log.h 00:02:05.706 TEST_HEADER include/spdk/lvol.h 00:02:05.706 CC examples/util/zipf/zipf.o 00:02:05.706 CC examples/ioat/verify/verify.o 00:02:05.706 TEST_HEADER include/spdk/memory.h 00:02:05.706 CC examples/sock/hello_world/hello_sock.o 00:02:05.706 CC examples/nvme/arbitration/arbitration.o 00:02:05.706 TEST_HEADER include/spdk/mmio.h 00:02:05.706 TEST_HEADER include/spdk/nbd.h 00:02:05.706 CC examples/vmd/lsvmd/lsvmd.o 00:02:05.706 CC examples/nvme/abort/abort.o 00:02:05.706 TEST_HEADER include/spdk/notify.h 00:02:05.706 CC examples/nvme/reconnect/reconnect.o 00:02:05.706 TEST_HEADER include/spdk/nvme.h 00:02:05.706 CC examples/ioat/perf/perf.o 00:02:05.706 CC test/app/histogram_perf/histogram_perf.o 00:02:05.706 CC examples/nvme/hello_world/hello_world.o 00:02:05.706 TEST_HEADER include/spdk/nvme_intel.h 00:02:05.706 CC examples/accel/perf/accel_perf.o 00:02:05.706 CC examples/nvme/hotplug/hotplug.o 00:02:05.706 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:05.706 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:05.706 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:05.706 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:05.706 CC test/app/jsoncat/jsoncat.o 00:02:05.706 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:05.706 CC examples/vmd/led/led.o 00:02:05.706 TEST_HEADER include/spdk/nvme_spec.h 00:02:05.706 CC test/event/reactor/reactor.o 00:02:05.706 TEST_HEADER include/spdk/nvme_zns.h 00:02:05.706 CC examples/blob/hello_world/hello_blob.o 00:02:05.706 CC test/event/event_perf/event_perf.o 00:02:05.706 CC test/env/memory/memory_ut.o 00:02:05.706 CC examples/idxd/perf/perf.o 00:02:05.706 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:05.706 CC app/fio/nvme/fio_plugin.o 00:02:05.706 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:05.706 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:05.706 CC examples/thread/thread/thread_ex.o 00:02:05.706 CC test/event/app_repeat/app_repeat.o 00:02:05.706 CC test/env/pci/pci_ut.o 00:02:05.706 TEST_HEADER include/spdk/nvmf.h 00:02:05.706 CC test/thread/poller_perf/poller_perf.o 00:02:05.706 TEST_HEADER include/spdk/nvmf_spec.h 00:02:05.706 CC test/event/reactor_perf/reactor_perf.o 00:02:05.706 TEST_HEADER include/spdk/nvmf_transport.h 00:02:05.706 CC test/nvme/sgl/sgl.o 00:02:05.706 CC examples/blob/cli/blobcli.o 00:02:05.706 CC test/app/stub/stub.o 00:02:05.707 CC test/env/vtophys/vtophys.o 00:02:05.707 TEST_HEADER include/spdk/opal.h 00:02:05.707 CC examples/bdev/bdevperf/bdevperf.o 00:02:05.707 TEST_HEADER include/spdk/opal_spec.h 00:02:05.707 CC test/nvme/boot_partition/boot_partition.o 00:02:05.707 CC test/accel/dif/dif.o 00:02:05.707 CC test/nvme/aer/aer.o 00:02:05.968 CC test/nvme/startup/startup.o 00:02:05.968 CC test/nvme/err_injection/err_injection.o 00:02:05.968 CC test/nvme/overhead/overhead.o 00:02:05.968 TEST_HEADER include/spdk/pci_ids.h 00:02:05.968 CC test/nvme/e2edp/nvme_dp.o 00:02:05.968 CC test/nvme/reserve/reserve.o 00:02:05.968 CC test/nvme/simple_copy/simple_copy.o 00:02:05.968 CC test/nvme/reset/reset.o 00:02:05.968 TEST_HEADER include/spdk/pipe.h 00:02:05.968 CC test/dma/test_dma/test_dma.o 00:02:05.968 CC examples/bdev/hello_world/hello_bdev.o 00:02:05.968 TEST_HEADER include/spdk/queue.h 00:02:05.968 CC test/event/scheduler/scheduler.o 00:02:05.968 CC test/nvme/compliance/nvme_compliance.o 00:02:05.968 TEST_HEADER include/spdk/reduce.h 00:02:05.968 CC test/nvme/connect_stress/connect_stress.o 00:02:05.968 TEST_HEADER include/spdk/rpc.h 00:02:05.968 CC test/bdev/bdevio/bdevio.o 00:02:05.968 TEST_HEADER include/spdk/scheduler.h 00:02:05.968 CC examples/nvmf/nvmf/nvmf.o 00:02:05.968 TEST_HEADER include/spdk/scsi.h 00:02:05.968 CC app/fio/bdev/fio_plugin.o 00:02:05.968 TEST_HEADER include/spdk/scsi_spec.h 00:02:05.968 TEST_HEADER include/spdk/sock.h 00:02:05.968 CC test/blobfs/mkfs/mkfs.o 00:02:05.968 TEST_HEADER include/spdk/stdinc.h 00:02:05.968 CC test/app/bdev_svc/bdev_svc.o 00:02:05.968 TEST_HEADER include/spdk/string.h 00:02:05.968 TEST_HEADER include/spdk/thread.h 00:02:05.968 TEST_HEADER include/spdk/trace.h 00:02:05.968 TEST_HEADER include/spdk/trace_parser.h 00:02:05.968 TEST_HEADER include/spdk/tree.h 00:02:05.968 TEST_HEADER include/spdk/ublk.h 00:02:05.968 TEST_HEADER include/spdk/util.h 00:02:05.968 TEST_HEADER include/spdk/uuid.h 00:02:05.968 TEST_HEADER include/spdk/version.h 00:02:05.968 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:05.968 LINK spdk_lspci 00:02:05.968 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:05.968 TEST_HEADER include/spdk/vhost.h 00:02:05.968 TEST_HEADER include/spdk/vmd.h 00:02:05.968 TEST_HEADER include/spdk/xor.h 00:02:05.968 TEST_HEADER include/spdk/zipf.h 00:02:05.968 LINK rpc_client_test 00:02:05.968 CXX test/cpp_headers/accel.o 00:02:05.968 CC test/lvol/esnap/esnap.o 00:02:05.968 LINK nvmf_tgt 00:02:05.968 CC test/env/mem_callbacks/mem_callbacks.o 00:02:05.968 LINK lsvmd 00:02:05.968 LINK interrupt_tgt 00:02:05.968 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:05.968 LINK zipf 00:02:05.968 LINK vhost 00:02:05.968 LINK histogram_perf 00:02:05.968 LINK spdk_nvme_discover 00:02:05.968 LINK jsoncat 00:02:05.968 LINK iscsi_tgt 00:02:05.968 LINK reactor 00:02:06.234 LINK spdk_trace_record 00:02:06.234 LINK app_repeat 00:02:06.234 LINK pmr_persistence 00:02:06.234 LINK vtophys 00:02:06.234 LINK led 00:02:06.234 LINK reactor_perf 00:02:06.234 LINK event_perf 00:02:06.234 LINK poller_perf 00:02:06.234 LINK ioat_perf 00:02:06.234 LINK hello_world 00:02:06.234 LINK env_dpdk_post_init 00:02:06.234 LINK spdk_tgt 00:02:06.234 LINK cmb_copy 00:02:06.234 LINK hello_blob 00:02:06.234 LINK verify 00:02:06.234 LINK boot_partition 00:02:06.234 LINK hotplug 00:02:06.234 LINK reserve 00:02:06.234 LINK stub 00:02:06.234 LINK bdev_svc 00:02:06.234 LINK thread 00:02:06.234 LINK err_injection 00:02:06.234 LINK mkfs 00:02:06.234 LINK simple_copy 00:02:06.234 LINK startup 00:02:06.234 LINK hello_sock 00:02:06.234 LINK connect_stress 00:02:06.234 LINK hello_bdev 00:02:06.234 LINK spdk_dd 00:02:06.234 LINK sgl 00:02:06.234 LINK scheduler 00:02:06.234 LINK arbitration 00:02:06.234 LINK aer 00:02:06.234 CXX test/cpp_headers/accel_module.o 00:02:06.497 LINK spdk_trace 00:02:06.498 CXX test/cpp_headers/assert.o 00:02:06.498 LINK reset 00:02:06.498 LINK reconnect 00:02:06.498 LINK nvme_dp 00:02:06.498 LINK nvmf 00:02:06.498 LINK overhead 00:02:06.498 LINK idxd_perf 00:02:06.498 LINK abort 00:02:06.498 LINK nvme_compliance 00:02:06.498 CXX test/cpp_headers/barrier.o 00:02:06.498 CXX test/cpp_headers/base64.o 00:02:06.498 CXX test/cpp_headers/bdev.o 00:02:06.498 LINK dif 00:02:06.498 LINK pci_ut 00:02:06.498 LINK bdevio 00:02:06.498 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:06.498 CXX test/cpp_headers/bdev_module.o 00:02:06.498 CXX test/cpp_headers/bdev_zone.o 00:02:06.498 CXX test/cpp_headers/bit_array.o 00:02:06.498 LINK test_dma 00:02:06.498 CXX test/cpp_headers/bit_pool.o 00:02:06.498 CXX test/cpp_headers/blob_bdev.o 00:02:06.498 CXX test/cpp_headers/blobfs_bdev.o 00:02:06.498 CXX test/cpp_headers/blobfs.o 00:02:06.498 CXX test/cpp_headers/blob.o 00:02:06.498 CXX test/cpp_headers/conf.o 00:02:06.498 CXX test/cpp_headers/config.o 00:02:06.498 CXX test/cpp_headers/cpuset.o 00:02:06.498 LINK accel_perf 00:02:06.498 CXX test/cpp_headers/crc16.o 00:02:06.756 CXX test/cpp_headers/crc32.o 00:02:06.756 CXX test/cpp_headers/crc64.o 00:02:06.756 CXX test/cpp_headers/dif.o 00:02:06.756 CC test/nvme/fused_ordering/fused_ordering.o 00:02:06.756 CXX test/cpp_headers/dma.o 00:02:06.756 CXX test/cpp_headers/endian.o 00:02:06.756 LINK nvme_manage 00:02:06.756 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:06.756 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:06.756 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:06.756 CC test/nvme/fdp/fdp.o 00:02:06.756 CXX test/cpp_headers/env.o 00:02:06.756 CXX test/cpp_headers/env_dpdk.o 00:02:06.756 CXX test/cpp_headers/event.o 00:02:06.756 LINK blobcli 00:02:06.756 CXX test/cpp_headers/fd_group.o 00:02:06.756 CXX test/cpp_headers/fd.o 00:02:06.756 CXX test/cpp_headers/file.o 00:02:06.756 CXX test/cpp_headers/ftl.o 00:02:06.756 LINK nvme_fuzz 00:02:06.756 CXX test/cpp_headers/gpt_spec.o 00:02:06.756 CC test/nvme/cuse/cuse.o 00:02:06.756 CXX test/cpp_headers/hexlify.o 00:02:06.756 CXX test/cpp_headers/histogram_data.o 00:02:06.756 CXX test/cpp_headers/idxd.o 00:02:06.756 CXX test/cpp_headers/idxd_spec.o 00:02:06.756 CXX test/cpp_headers/init.o 00:02:06.756 LINK spdk_nvme 00:02:06.756 CXX test/cpp_headers/ioat_spec.o 00:02:06.756 CXX test/cpp_headers/ioat.o 00:02:06.756 CXX test/cpp_headers/iscsi_spec.o 00:02:06.756 CXX test/cpp_headers/json.o 00:02:06.756 CXX test/cpp_headers/jsonrpc.o 00:02:06.756 CXX test/cpp_headers/keyring.o 00:02:06.756 CXX test/cpp_headers/keyring_module.o 00:02:06.756 CXX test/cpp_headers/likely.o 00:02:06.756 CXX test/cpp_headers/log.o 00:02:06.756 CXX test/cpp_headers/lvol.o 00:02:06.756 CXX test/cpp_headers/memory.o 00:02:06.756 CXX test/cpp_headers/mmio.o 00:02:06.756 LINK spdk_bdev 00:02:06.756 CXX test/cpp_headers/nbd.o 00:02:06.756 CXX test/cpp_headers/notify.o 00:02:06.756 CXX test/cpp_headers/nvme.o 00:02:06.756 CXX test/cpp_headers/nvme_intel.o 00:02:06.756 CXX test/cpp_headers/nvme_ocssd.o 00:02:06.756 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:06.756 CXX test/cpp_headers/nvme_spec.o 00:02:07.022 CXX test/cpp_headers/nvme_zns.o 00:02:07.022 CXX test/cpp_headers/nvmf_cmd.o 00:02:07.022 LINK spdk_nvme_perf 00:02:07.022 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:07.022 LINK mem_callbacks 00:02:07.022 CXX test/cpp_headers/nvmf.o 00:02:07.022 CXX test/cpp_headers/nvmf_spec.o 00:02:07.022 CXX test/cpp_headers/nvmf_transport.o 00:02:07.022 CXX test/cpp_headers/opal.o 00:02:07.022 CXX test/cpp_headers/opal_spec.o 00:02:07.022 CXX test/cpp_headers/pci_ids.o 00:02:07.022 CXX test/cpp_headers/pipe.o 00:02:07.022 CXX test/cpp_headers/reduce.o 00:02:07.022 CXX test/cpp_headers/queue.o 00:02:07.022 CXX test/cpp_headers/rpc.o 00:02:07.022 CXX test/cpp_headers/scheduler.o 00:02:07.022 CXX test/cpp_headers/scsi.o 00:02:07.022 LINK fused_ordering 00:02:07.022 CXX test/cpp_headers/scsi_spec.o 00:02:07.022 CXX test/cpp_headers/sock.o 00:02:07.022 CXX test/cpp_headers/stdinc.o 00:02:07.022 CXX test/cpp_headers/string.o 00:02:07.022 CXX test/cpp_headers/thread.o 00:02:07.022 LINK spdk_nvme_identify 00:02:07.022 CXX test/cpp_headers/trace.o 00:02:07.022 CXX test/cpp_headers/trace_parser.o 00:02:07.022 CXX test/cpp_headers/tree.o 00:02:07.022 CXX test/cpp_headers/ublk.o 00:02:07.022 CXX test/cpp_headers/util.o 00:02:07.022 CXX test/cpp_headers/uuid.o 00:02:07.022 LINK doorbell_aers 00:02:07.022 CXX test/cpp_headers/version.o 00:02:07.022 CXX test/cpp_headers/vfio_user_pci.o 00:02:07.022 CXX test/cpp_headers/vfio_user_spec.o 00:02:07.022 CXX test/cpp_headers/vhost.o 00:02:07.022 CXX test/cpp_headers/vmd.o 00:02:07.281 CXX test/cpp_headers/xor.o 00:02:07.281 CXX test/cpp_headers/zipf.o 00:02:07.281 LINK spdk_top 00:02:07.281 LINK bdevperf 00:02:07.281 LINK fdp 00:02:07.281 LINK vhost_fuzz 00:02:07.281 LINK memory_ut 00:02:08.214 LINK cuse 00:02:08.214 LINK iscsi_fuzz 00:02:10.116 LINK esnap 00:02:10.374 00:02:10.375 real 0m48.151s 00:02:10.375 user 6m59.648s 00:02:10.375 sys 3m14.628s 00:02:10.375 19:08:57 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:10.375 19:08:57 -- common/autotest_common.sh@10 -- $ set +x 00:02:10.375 ************************************ 00:02:10.375 END TEST make 00:02:10.375 ************************************ 00:02:10.375 19:08:57 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:10.375 19:08:57 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:10.375 19:08:57 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:10.375 19:08:57 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.375 19:08:57 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:10.375 19:08:57 -- pm/common@45 -- $ pid=2779219 00:02:10.375 19:08:57 -- pm/common@52 -- $ sudo kill -TERM 2779219 00:02:10.375 19:08:57 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.375 19:08:57 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:10.375 19:08:57 -- pm/common@45 -- $ pid=2779220 00:02:10.375 19:08:57 -- pm/common@52 -- $ sudo kill -TERM 2779220 00:02:10.634 19:08:57 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.634 19:08:57 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:10.634 19:08:57 -- pm/common@45 -- $ pid=2779224 00:02:10.634 19:08:57 -- pm/common@52 -- $ sudo kill -TERM 2779224 00:02:10.634 19:08:57 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.634 19:08:57 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:10.634 19:08:57 -- pm/common@45 -- $ pid=2779222 00:02:10.634 19:08:57 -- pm/common@52 -- $ sudo kill -TERM 2779222 00:02:10.634 19:08:57 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:02:10.634 19:08:57 -- nvmf/common.sh@7 -- # uname -s 00:02:10.634 19:08:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:10.634 19:08:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:10.634 19:08:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:10.634 19:08:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:10.634 19:08:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:10.634 19:08:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:10.634 19:08:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:10.634 19:08:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:10.634 19:08:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:10.634 19:08:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:10.634 19:08:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:02:10.634 19:08:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:02:10.634 19:08:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:10.634 19:08:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:10.634 19:08:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:10.634 19:08:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:10.634 19:08:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:02:10.634 19:08:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:10.634 19:08:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:10.634 19:08:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:10.634 19:08:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:10.634 19:08:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:10.634 19:08:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:10.634 19:08:57 -- paths/export.sh@5 -- # export PATH 00:02:10.634 19:08:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:10.634 19:08:57 -- nvmf/common.sh@47 -- # : 0 00:02:10.634 19:08:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:10.634 19:08:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:10.634 19:08:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:10.634 19:08:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:10.634 19:08:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:10.634 19:08:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:10.634 19:08:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:10.634 19:08:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:10.634 19:08:57 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:10.634 19:08:57 -- spdk/autotest.sh@32 -- # uname -s 00:02:10.634 19:08:57 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:10.634 19:08:57 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:10.634 19:08:57 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:10.634 19:08:57 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:10.634 19:08:57 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:10.634 19:08:57 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:10.634 19:08:57 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:10.634 19:08:57 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:10.634 19:08:57 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:10.634 19:08:57 -- spdk/autotest.sh@48 -- # udevadm_pid=2835742 00:02:10.634 19:08:57 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:10.634 19:08:57 -- pm/common@17 -- # local monitor 00:02:10.634 19:08:57 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.634 19:08:57 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2835744 00:02:10.634 19:08:57 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.634 19:08:57 -- pm/common@21 -- # date +%s 00:02:10.634 19:08:57 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2835747 00:02:10.634 19:08:57 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.634 19:08:57 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2835750 00:02:10.634 19:08:57 -- pm/common@21 -- # date +%s 00:02:10.634 19:08:57 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:10.893 19:08:57 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=2835753 00:02:10.893 19:08:57 -- pm/common@26 -- # sleep 1 00:02:10.893 19:08:57 -- pm/common@21 -- # date +%s 00:02:10.893 19:08:57 -- pm/common@21 -- # date +%s 00:02:10.893 19:08:57 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713978537 00:02:10.893 19:08:57 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713978537 00:02:10.893 19:08:57 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713978537 00:02:10.893 19:08:57 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713978537 00:02:10.893 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713978537_collect-vmstat.pm.log 00:02:10.893 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713978537_collect-cpu-load.pm.log 00:02:10.893 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713978537_collect-bmc-pm.bmc.pm.log 00:02:10.893 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713978537_collect-cpu-temp.pm.log 00:02:11.828 19:08:58 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:11.828 19:08:58 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:11.828 19:08:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:11.828 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:02:11.828 19:08:58 -- spdk/autotest.sh@59 -- # create_test_list 00:02:11.828 19:08:58 -- common/autotest_common.sh@734 -- # xtrace_disable 00:02:11.828 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:02:11.828 19:08:58 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:02:11.828 19:08:58 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:11.828 19:08:58 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:11.828 19:08:58 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:02:11.828 19:08:58 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:11.828 19:08:58 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:11.828 19:08:58 -- common/autotest_common.sh@1441 -- # uname 00:02:11.828 19:08:58 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:02:11.828 19:08:58 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:11.828 19:08:58 -- common/autotest_common.sh@1461 -- # uname 00:02:11.828 19:08:58 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:02:11.828 19:08:58 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:11.828 19:08:58 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:11.828 19:08:58 -- spdk/autotest.sh@72 -- # hash lcov 00:02:11.828 19:08:58 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:11.828 19:08:58 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:11.828 --rc lcov_branch_coverage=1 00:02:11.828 --rc lcov_function_coverage=1 00:02:11.828 --rc genhtml_branch_coverage=1 00:02:11.828 --rc genhtml_function_coverage=1 00:02:11.828 --rc genhtml_legend=1 00:02:11.828 --rc geninfo_all_blocks=1 00:02:11.828 ' 00:02:11.828 19:08:58 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:11.828 --rc lcov_branch_coverage=1 00:02:11.828 --rc lcov_function_coverage=1 00:02:11.828 --rc genhtml_branch_coverage=1 00:02:11.828 --rc genhtml_function_coverage=1 00:02:11.828 --rc genhtml_legend=1 00:02:11.828 --rc geninfo_all_blocks=1 00:02:11.828 ' 00:02:11.828 19:08:58 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:11.828 --rc lcov_branch_coverage=1 00:02:11.828 --rc lcov_function_coverage=1 00:02:11.828 --rc genhtml_branch_coverage=1 00:02:11.828 --rc genhtml_function_coverage=1 00:02:11.828 --rc genhtml_legend=1 00:02:11.828 --rc geninfo_all_blocks=1 00:02:11.828 --no-external' 00:02:11.828 19:08:58 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:11.828 --rc lcov_branch_coverage=1 00:02:11.828 --rc lcov_function_coverage=1 00:02:11.828 --rc genhtml_branch_coverage=1 00:02:11.828 --rc genhtml_function_coverage=1 00:02:11.828 --rc genhtml_legend=1 00:02:11.828 --rc geninfo_all_blocks=1 00:02:11.828 --no-external' 00:02:11.828 19:08:58 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:11.828 lcov: LCOV version 1.14 00:02:11.828 19:08:58 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:18.391 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:18.391 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:18.392 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:18.649 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:18.649 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:18.649 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:18.649 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:18.649 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:18.649 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:18.649 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:18.650 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:18.650 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:18.908 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:18.909 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:18.909 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:22.283 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:22.283 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:30.448 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:30.448 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:30.448 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:30.448 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:30.448 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:30.448 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:35.724 19:09:22 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:35.724 19:09:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:35.724 19:09:22 -- common/autotest_common.sh@10 -- # set +x 00:02:35.724 19:09:22 -- spdk/autotest.sh@91 -- # rm -f 00:02:35.724 19:09:22 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:39.012 0000:5f:00.0 (8086 0a54): Already using the nvme driver 00:02:39.012 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:39.012 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:39.012 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:39.012 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:39.012 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:39.012 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:39.270 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:39.529 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:39.529 19:09:26 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:39.529 19:09:26 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:39.529 19:09:26 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:39.529 19:09:26 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:39.529 19:09:26 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:39.529 19:09:26 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:39.529 19:09:26 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:39.529 19:09:26 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:39.529 19:09:26 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:39.529 19:09:26 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:02:39.529 19:09:26 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:39.529 19:09:26 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:39.529 19:09:26 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:39.529 19:09:26 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:39.529 19:09:26 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:39.529 No valid GPT data, bailing 00:02:39.529 19:09:26 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:39.529 19:09:26 -- scripts/common.sh@391 -- # pt= 00:02:39.529 19:09:26 -- scripts/common.sh@392 -- # return 1 00:02:39.529 19:09:26 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:39.529 1+0 records in 00:02:39.529 1+0 records out 00:02:39.529 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00521469 s, 201 MB/s 00:02:39.529 19:09:26 -- spdk/autotest.sh@118 -- # sync 00:02:39.529 19:09:26 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:39.529 19:09:26 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:39.529 19:09:26 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:44.798 19:09:31 -- spdk/autotest.sh@124 -- # uname -s 00:02:44.798 19:09:31 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:02:44.798 19:09:31 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:44.798 19:09:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:44.798 19:09:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:44.798 19:09:31 -- common/autotest_common.sh@10 -- # set +x 00:02:45.056 ************************************ 00:02:45.056 START TEST setup.sh 00:02:45.056 ************************************ 00:02:45.056 19:09:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:45.056 * Looking for test storage... 00:02:45.056 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:45.056 19:09:31 -- setup/test-setup.sh@10 -- # uname -s 00:02:45.056 19:09:31 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:45.056 19:09:31 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:45.056 19:09:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.056 19:09:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.056 19:09:31 -- common/autotest_common.sh@10 -- # set +x 00:02:45.314 ************************************ 00:02:45.314 START TEST acl 00:02:45.314 ************************************ 00:02:45.315 19:09:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:45.315 * Looking for test storage... 00:02:45.315 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:45.315 19:09:32 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:45.315 19:09:32 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:45.315 19:09:32 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:45.315 19:09:32 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:45.315 19:09:32 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:45.315 19:09:32 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:45.315 19:09:32 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:45.315 19:09:32 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:45.315 19:09:32 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:45.315 19:09:32 -- setup/acl.sh@12 -- # devs=() 00:02:45.315 19:09:32 -- setup/acl.sh@12 -- # declare -a devs 00:02:45.315 19:09:32 -- setup/acl.sh@13 -- # drivers=() 00:02:45.315 19:09:32 -- setup/acl.sh@13 -- # declare -A drivers 00:02:45.315 19:09:32 -- setup/acl.sh@51 -- # setup reset 00:02:45.315 19:09:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:45.315 19:09:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:49.501 19:09:35 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:49.501 19:09:35 -- setup/acl.sh@16 -- # local dev driver 00:02:49.501 19:09:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.501 19:09:35 -- setup/acl.sh@15 -- # setup output status 00:02:49.501 19:09:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.501 19:09:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:02:52.787 Hugepages 00:02:52.787 node hugesize free / total 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 00:02:52.787 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:5f:00.0 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:52.787 19:09:39 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.787 19:09:39 -- setup/acl.sh@20 -- # continue 00:02:52.787 19:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.787 19:09:39 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:52.787 19:09:39 -- setup/acl.sh@54 -- # run_test denied denied 00:02:52.787 19:09:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.787 19:09:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.787 19:09:39 -- common/autotest_common.sh@10 -- # set +x 00:02:52.787 ************************************ 00:02:52.787 START TEST denied 00:02:52.787 ************************************ 00:02:52.787 19:09:39 -- common/autotest_common.sh@1111 -- # denied 00:02:52.787 19:09:39 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5f:00.0' 00:02:52.787 19:09:39 -- setup/acl.sh@38 -- # setup output config 00:02:52.787 19:09:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:52.787 19:09:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:52.788 19:09:39 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5f:00.0' 00:02:56.071 0000:5f:00.0 (8086 0a54): Skipping denied controller at 0000:5f:00.0 00:02:56.071 19:09:42 -- setup/acl.sh@40 -- # verify 0000:5f:00.0 00:02:56.071 19:09:42 -- setup/acl.sh@28 -- # local dev driver 00:02:56.071 19:09:42 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:56.071 19:09:42 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5f:00.0 ]] 00:02:56.071 19:09:42 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5f:00.0/driver 00:02:56.071 19:09:42 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:56.071 19:09:42 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:56.071 19:09:42 -- setup/acl.sh@41 -- # setup reset 00:02:56.071 19:09:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:56.071 19:09:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:01.339 00:03:01.339 real 0m7.803s 00:03:01.339 user 0m2.462s 00:03:01.339 sys 0m4.650s 00:03:01.339 19:09:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:01.339 19:09:47 -- common/autotest_common.sh@10 -- # set +x 00:03:01.339 ************************************ 00:03:01.339 END TEST denied 00:03:01.339 ************************************ 00:03:01.339 19:09:47 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:01.339 19:09:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.339 19:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.339 19:09:47 -- common/autotest_common.sh@10 -- # set +x 00:03:01.339 ************************************ 00:03:01.339 START TEST allowed 00:03:01.339 ************************************ 00:03:01.339 19:09:47 -- common/autotest_common.sh@1111 -- # allowed 00:03:01.339 19:09:47 -- setup/acl.sh@46 -- # grep -E '0000:5f:00.0 .*: nvme -> .*' 00:03:01.339 19:09:47 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5f:00.0 00:03:01.339 19:09:47 -- setup/acl.sh@45 -- # setup output config 00:03:01.339 19:09:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:01.339 19:09:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:06.638 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:03:06.638 19:09:52 -- setup/acl.sh@47 -- # verify 00:03:06.638 19:09:52 -- setup/acl.sh@28 -- # local dev driver 00:03:06.638 19:09:52 -- setup/acl.sh@48 -- # setup reset 00:03:06.638 19:09:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:06.638 19:09:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.921 00:03:09.921 real 0m8.690s 00:03:09.921 user 0m2.357s 00:03:09.921 sys 0m4.474s 00:03:09.921 19:09:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:09.921 19:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:09.921 ************************************ 00:03:09.921 END TEST allowed 00:03:09.921 ************************************ 00:03:09.921 00:03:09.921 real 0m24.102s 00:03:09.921 user 0m7.587s 00:03:09.921 sys 0m14.198s 00:03:09.921 19:09:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:09.921 19:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:09.921 ************************************ 00:03:09.921 END TEST acl 00:03:09.921 ************************************ 00:03:09.921 19:09:56 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:09.921 19:09:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.921 19:09:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.921 19:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:09.921 ************************************ 00:03:09.921 START TEST hugepages 00:03:09.921 ************************************ 00:03:09.921 19:09:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:09.921 * Looking for test storage... 00:03:09.921 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:09.921 19:09:56 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:09.921 19:09:56 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:09.921 19:09:56 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:09.921 19:09:56 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:09.921 19:09:56 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:09.921 19:09:56 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:09.921 19:09:56 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:09.921 19:09:56 -- setup/common.sh@18 -- # local node= 00:03:09.921 19:09:56 -- setup/common.sh@19 -- # local var val 00:03:09.921 19:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.921 19:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.921 19:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:09.921 19:09:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:09.921 19:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.921 19:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 38956512 kB' 'MemAvailable: 43690128 kB' 'Buffers: 14584 kB' 'Cached: 14547048 kB' 'SwapCached: 0 kB' 'Active: 10973900 kB' 'Inactive: 4091048 kB' 'Active(anon): 9941256 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 506584 kB' 'Mapped: 191152 kB' 'Shmem: 9437940 kB' 'KReclaimable: 213732 kB' 'Slab: 620020 kB' 'SReclaimable: 213732 kB' 'SUnreclaim: 406288 kB' 'KernelStack: 16752 kB' 'PageTables: 8916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36439252 kB' 'Committed_AS: 11228824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203140 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.921 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.921 19:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # continue 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.922 19:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.922 19:09:56 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:09.922 19:09:56 -- setup/common.sh@33 -- # echo 2048 00:03:09.922 19:09:56 -- setup/common.sh@33 -- # return 0 00:03:09.922 19:09:56 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:09.922 19:09:56 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:09.922 19:09:56 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:09.922 19:09:56 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:09.922 19:09:56 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:09.922 19:09:56 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:09.922 19:09:56 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:09.922 19:09:56 -- setup/hugepages.sh@207 -- # get_nodes 00:03:09.922 19:09:56 -- setup/hugepages.sh@27 -- # local node 00:03:09.922 19:09:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:09.922 19:09:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:09.922 19:09:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:09.922 19:09:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:09.922 19:09:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:09.922 19:09:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:09.922 19:09:56 -- setup/hugepages.sh@208 -- # clear_hp 00:03:09.922 19:09:56 -- setup/hugepages.sh@37 -- # local node hp 00:03:09.922 19:09:56 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:09.922 19:09:56 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:09.922 19:09:56 -- setup/hugepages.sh@41 -- # echo 0 00:03:09.922 19:09:56 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:09.922 19:09:56 -- setup/hugepages.sh@41 -- # echo 0 00:03:09.922 19:09:56 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:09.922 19:09:56 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:09.922 19:09:56 -- setup/hugepages.sh@41 -- # echo 0 00:03:09.922 19:09:56 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:09.922 19:09:56 -- setup/hugepages.sh@41 -- # echo 0 00:03:09.922 19:09:56 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:09.922 19:09:56 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:09.922 19:09:56 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:09.922 19:09:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.922 19:09:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.922 19:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:09.922 ************************************ 00:03:09.922 START TEST default_setup 00:03:09.922 ************************************ 00:03:09.922 19:09:56 -- common/autotest_common.sh@1111 -- # default_setup 00:03:09.922 19:09:56 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:09.923 19:09:56 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:09.923 19:09:56 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:09.923 19:09:56 -- setup/hugepages.sh@51 -- # shift 00:03:09.923 19:09:56 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:09.923 19:09:56 -- setup/hugepages.sh@52 -- # local node_ids 00:03:09.923 19:09:56 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:09.923 19:09:56 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:09.923 19:09:56 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:09.923 19:09:56 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:09.923 19:09:56 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:09.923 19:09:56 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:09.923 19:09:56 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:09.923 19:09:56 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:09.923 19:09:56 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:09.923 19:09:56 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:09.923 19:09:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:09.923 19:09:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:09.923 19:09:56 -- setup/hugepages.sh@73 -- # return 0 00:03:09.923 19:09:56 -- setup/hugepages.sh@137 -- # setup output 00:03:09.923 19:09:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:09.923 19:09:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:13.209 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:13.209 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:15.116 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:03:15.116 19:10:01 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:15.116 19:10:01 -- setup/hugepages.sh@89 -- # local node 00:03:15.116 19:10:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:15.116 19:10:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:15.116 19:10:01 -- setup/hugepages.sh@92 -- # local surp 00:03:15.116 19:10:01 -- setup/hugepages.sh@93 -- # local resv 00:03:15.116 19:10:01 -- setup/hugepages.sh@94 -- # local anon 00:03:15.117 19:10:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:15.117 19:10:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:15.117 19:10:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:15.117 19:10:01 -- setup/common.sh@18 -- # local node= 00:03:15.117 19:10:01 -- setup/common.sh@19 -- # local var val 00:03:15.117 19:10:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.117 19:10:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.117 19:10:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.117 19:10:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.117 19:10:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.117 19:10:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41116356 kB' 'MemAvailable: 45849924 kB' 'Buffers: 14584 kB' 'Cached: 14547156 kB' 'SwapCached: 0 kB' 'Active: 10987236 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954592 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519836 kB' 'Mapped: 191376 kB' 'Shmem: 9438048 kB' 'KReclaimable: 213636 kB' 'Slab: 618736 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405100 kB' 'KernelStack: 16864 kB' 'PageTables: 9004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11239208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203204 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.117 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.117 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.118 19:10:01 -- setup/common.sh@33 -- # echo 0 00:03:15.118 19:10:01 -- setup/common.sh@33 -- # return 0 00:03:15.118 19:10:01 -- setup/hugepages.sh@97 -- # anon=0 00:03:15.118 19:10:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:15.118 19:10:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.118 19:10:01 -- setup/common.sh@18 -- # local node= 00:03:15.118 19:10:01 -- setup/common.sh@19 -- # local var val 00:03:15.118 19:10:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.118 19:10:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.118 19:10:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.118 19:10:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.118 19:10:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.118 19:10:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41116824 kB' 'MemAvailable: 45850392 kB' 'Buffers: 14584 kB' 'Cached: 14547160 kB' 'SwapCached: 0 kB' 'Active: 10987552 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954908 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520124 kB' 'Mapped: 191364 kB' 'Shmem: 9438052 kB' 'KReclaimable: 213636 kB' 'Slab: 618760 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405124 kB' 'KernelStack: 16880 kB' 'PageTables: 8876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11239220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203188 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.118 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.118 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.119 19:10:01 -- setup/common.sh@33 -- # echo 0 00:03:15.119 19:10:01 -- setup/common.sh@33 -- # return 0 00:03:15.119 19:10:01 -- setup/hugepages.sh@99 -- # surp=0 00:03:15.119 19:10:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:15.119 19:10:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:15.119 19:10:01 -- setup/common.sh@18 -- # local node= 00:03:15.119 19:10:01 -- setup/common.sh@19 -- # local var val 00:03:15.119 19:10:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.119 19:10:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.119 19:10:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.119 19:10:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.119 19:10:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.119 19:10:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41114908 kB' 'MemAvailable: 45848476 kB' 'Buffers: 14584 kB' 'Cached: 14547172 kB' 'SwapCached: 0 kB' 'Active: 10987380 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954736 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519952 kB' 'Mapped: 191364 kB' 'Shmem: 9438064 kB' 'KReclaimable: 213636 kB' 'Slab: 618684 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405048 kB' 'KernelStack: 16832 kB' 'PageTables: 9196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11239232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203172 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.119 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.119 19:10:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:01 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.120 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.120 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.121 19:10:02 -- setup/common.sh@33 -- # echo 0 00:03:15.121 19:10:02 -- setup/common.sh@33 -- # return 0 00:03:15.121 19:10:02 -- setup/hugepages.sh@100 -- # resv=0 00:03:15.121 19:10:02 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:15.121 nr_hugepages=1024 00:03:15.121 19:10:02 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:15.121 resv_hugepages=0 00:03:15.121 19:10:02 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:15.121 surplus_hugepages=0 00:03:15.121 19:10:02 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:15.121 anon_hugepages=0 00:03:15.121 19:10:02 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.121 19:10:02 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:15.121 19:10:02 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:15.121 19:10:02 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:15.121 19:10:02 -- setup/common.sh@18 -- # local node= 00:03:15.121 19:10:02 -- setup/common.sh@19 -- # local var val 00:03:15.121 19:10:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.121 19:10:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.121 19:10:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.121 19:10:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.121 19:10:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.121 19:10:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.121 19:10:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41113852 kB' 'MemAvailable: 45847420 kB' 'Buffers: 14584 kB' 'Cached: 14547188 kB' 'SwapCached: 0 kB' 'Active: 10988304 kB' 'Inactive: 4091048 kB' 'Active(anon): 9955660 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520956 kB' 'Mapped: 191364 kB' 'Shmem: 9438080 kB' 'KReclaimable: 213636 kB' 'Slab: 618684 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405048 kB' 'KernelStack: 17024 kB' 'PageTables: 9696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11238908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203268 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.121 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.121 19:10:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.122 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.122 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.123 19:10:02 -- setup/common.sh@33 -- # echo 1024 00:03:15.123 19:10:02 -- setup/common.sh@33 -- # return 0 00:03:15.123 19:10:02 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.123 19:10:02 -- setup/hugepages.sh@112 -- # get_nodes 00:03:15.123 19:10:02 -- setup/hugepages.sh@27 -- # local node 00:03:15.123 19:10:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.123 19:10:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:15.123 19:10:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.123 19:10:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:15.123 19:10:02 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:15.123 19:10:02 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:15.123 19:10:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.123 19:10:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.123 19:10:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:15.123 19:10:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.123 19:10:02 -- setup/common.sh@18 -- # local node=0 00:03:15.123 19:10:02 -- setup/common.sh@19 -- # local var val 00:03:15.123 19:10:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.123 19:10:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.123 19:10:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:15.123 19:10:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:15.123 19:10:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.123 19:10:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.123 19:10:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 15745224 kB' 'MemUsed: 16841824 kB' 'SwapCached: 0 kB' 'Active: 9522372 kB' 'Inactive: 3929180 kB' 'Active(anon): 9107788 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100324 kB' 'Mapped: 128172 kB' 'AnonPages: 354380 kB' 'Shmem: 8756560 kB' 'KernelStack: 9288 kB' 'PageTables: 5116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 366352 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237752 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.123 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.123 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # continue 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.124 19:10:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.124 19:10:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.124 19:10:02 -- setup/common.sh@33 -- # echo 0 00:03:15.124 19:10:02 -- setup/common.sh@33 -- # return 0 00:03:15.124 19:10:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.124 19:10:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.124 19:10:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.124 19:10:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.124 19:10:02 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:15.124 node0=1024 expecting 1024 00:03:15.124 19:10:02 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:15.124 00:03:15.124 real 0m5.296s 00:03:15.124 user 0m1.377s 00:03:15.124 sys 0m2.187s 00:03:15.124 19:10:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:15.124 19:10:02 -- common/autotest_common.sh@10 -- # set +x 00:03:15.124 ************************************ 00:03:15.124 END TEST default_setup 00:03:15.124 ************************************ 00:03:15.124 19:10:02 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:15.124 19:10:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.124 19:10:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.124 19:10:02 -- common/autotest_common.sh@10 -- # set +x 00:03:15.384 ************************************ 00:03:15.384 START TEST per_node_1G_alloc 00:03:15.384 ************************************ 00:03:15.384 19:10:02 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:03:15.384 19:10:02 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:15.384 19:10:02 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:15.384 19:10:02 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:15.384 19:10:02 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:15.384 19:10:02 -- setup/hugepages.sh@51 -- # shift 00:03:15.384 19:10:02 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:15.384 19:10:02 -- setup/hugepages.sh@52 -- # local node_ids 00:03:15.384 19:10:02 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.384 19:10:02 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:15.384 19:10:02 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:15.384 19:10:02 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:15.384 19:10:02 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.384 19:10:02 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:15.384 19:10:02 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.384 19:10:02 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.384 19:10:02 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.384 19:10:02 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:15.384 19:10:02 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:15.384 19:10:02 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:15.384 19:10:02 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:15.384 19:10:02 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:15.384 19:10:02 -- setup/hugepages.sh@73 -- # return 0 00:03:15.384 19:10:02 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:15.384 19:10:02 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:15.384 19:10:02 -- setup/hugepages.sh@146 -- # setup output 00:03:15.384 19:10:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.384 19:10:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:18.721 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.721 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:18.721 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:18.721 19:10:05 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:18.721 19:10:05 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:18.721 19:10:05 -- setup/hugepages.sh@89 -- # local node 00:03:18.721 19:10:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.721 19:10:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.721 19:10:05 -- setup/hugepages.sh@92 -- # local surp 00:03:18.721 19:10:05 -- setup/hugepages.sh@93 -- # local resv 00:03:18.721 19:10:05 -- setup/hugepages.sh@94 -- # local anon 00:03:18.721 19:10:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.721 19:10:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.721 19:10:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.721 19:10:05 -- setup/common.sh@18 -- # local node= 00:03:18.721 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.721 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.721 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.721 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.721 19:10:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.721 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.721 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41100448 kB' 'MemAvailable: 45834016 kB' 'Buffers: 14584 kB' 'Cached: 14547264 kB' 'SwapCached: 0 kB' 'Active: 10986472 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953828 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518872 kB' 'Mapped: 191392 kB' 'Shmem: 9438156 kB' 'KReclaimable: 213636 kB' 'Slab: 618736 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405100 kB' 'KernelStack: 16496 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11237272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.721 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.721 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.722 19:10:05 -- setup/common.sh@33 -- # echo 0 00:03:18.722 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.722 19:10:05 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.722 19:10:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.722 19:10:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.722 19:10:05 -- setup/common.sh@18 -- # local node= 00:03:18.722 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.722 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.722 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.722 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.722 19:10:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.722 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.722 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41102840 kB' 'MemAvailable: 45836408 kB' 'Buffers: 14584 kB' 'Cached: 14547268 kB' 'SwapCached: 0 kB' 'Active: 10986628 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953984 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519060 kB' 'Mapped: 191392 kB' 'Shmem: 9438160 kB' 'KReclaimable: 213636 kB' 'Slab: 618744 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405108 kB' 'KernelStack: 16496 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11237284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.722 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.722 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.723 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.723 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.724 19:10:05 -- setup/common.sh@33 -- # echo 0 00:03:18.724 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.724 19:10:05 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.724 19:10:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.724 19:10:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.724 19:10:05 -- setup/common.sh@18 -- # local node= 00:03:18.724 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.724 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.724 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.724 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.724 19:10:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.724 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.724 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41104096 kB' 'MemAvailable: 45837664 kB' 'Buffers: 14584 kB' 'Cached: 14547280 kB' 'SwapCached: 0 kB' 'Active: 10986796 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954152 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519228 kB' 'Mapped: 191392 kB' 'Shmem: 9438172 kB' 'KReclaimable: 213636 kB' 'Slab: 618744 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405108 kB' 'KernelStack: 16512 kB' 'PageTables: 8196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11237300 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.724 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.724 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.725 19:10:05 -- setup/common.sh@33 -- # echo 0 00:03:18.725 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.725 19:10:05 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.725 19:10:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:18.725 nr_hugepages=1024 00:03:18.725 19:10:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.725 resv_hugepages=0 00:03:18.725 19:10:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.725 surplus_hugepages=0 00:03:18.725 19:10:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.725 anon_hugepages=0 00:03:18.725 19:10:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.725 19:10:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:18.725 19:10:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.725 19:10:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.725 19:10:05 -- setup/common.sh@18 -- # local node= 00:03:18.725 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.725 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.725 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.725 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.725 19:10:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.725 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.725 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41103348 kB' 'MemAvailable: 45836916 kB' 'Buffers: 14584 kB' 'Cached: 14547292 kB' 'SwapCached: 0 kB' 'Active: 10986648 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954004 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519052 kB' 'Mapped: 191392 kB' 'Shmem: 9438184 kB' 'KReclaimable: 213636 kB' 'Slab: 618744 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405108 kB' 'KernelStack: 16496 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11237312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.725 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.725 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.726 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.726 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.727 19:10:05 -- setup/common.sh@33 -- # echo 1024 00:03:18.727 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.727 19:10:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.727 19:10:05 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.727 19:10:05 -- setup/hugepages.sh@27 -- # local node 00:03:18.727 19:10:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.727 19:10:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.727 19:10:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.727 19:10:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.727 19:10:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.727 19:10:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.727 19:10:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.727 19:10:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.727 19:10:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.727 19:10:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.727 19:10:05 -- setup/common.sh@18 -- # local node=0 00:03:18.727 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.727 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.727 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.727 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.727 19:10:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.727 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.727 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 16790436 kB' 'MemUsed: 15796612 kB' 'SwapCached: 0 kB' 'Active: 9522316 kB' 'Inactive: 3929180 kB' 'Active(anon): 9107732 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100328 kB' 'Mapped: 128172 kB' 'AnonPages: 354268 kB' 'Shmem: 8756564 kB' 'KernelStack: 9176 kB' 'PageTables: 5116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 365884 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237284 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.727 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.727 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@33 -- # echo 0 00:03:18.728 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.728 19:10:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.728 19:10:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.728 19:10:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.728 19:10:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.728 19:10:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.728 19:10:05 -- setup/common.sh@18 -- # local node=1 00:03:18.728 19:10:05 -- setup/common.sh@19 -- # local var val 00:03:18.728 19:10:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.728 19:10:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.728 19:10:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.728 19:10:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.728 19:10:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.728 19:10:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708556 kB' 'MemFree: 24312660 kB' 'MemUsed: 3395896 kB' 'SwapCached: 0 kB' 'Active: 1464808 kB' 'Inactive: 161868 kB' 'Active(anon): 846748 kB' 'Inactive(anon): 0 kB' 'Active(file): 618060 kB' 'Inactive(file): 161868 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1461576 kB' 'Mapped: 63220 kB' 'AnonPages: 165260 kB' 'Shmem: 681648 kB' 'KernelStack: 7336 kB' 'PageTables: 3080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85036 kB' 'Slab: 252860 kB' 'SReclaimable: 85036 kB' 'SUnreclaim: 167824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.728 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.728 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # continue 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.729 19:10:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.729 19:10:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.729 19:10:05 -- setup/common.sh@33 -- # echo 0 00:03:18.729 19:10:05 -- setup/common.sh@33 -- # return 0 00:03:18.729 19:10:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.729 19:10:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.729 19:10:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.729 19:10:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.729 19:10:05 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:18.729 node0=512 expecting 512 00:03:18.729 19:10:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.729 19:10:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.729 19:10:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.729 19:10:05 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:18.729 node1=512 expecting 512 00:03:18.729 19:10:05 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:18.729 00:03:18.729 real 0m3.445s 00:03:18.729 user 0m1.346s 00:03:18.729 sys 0m2.176s 00:03:18.729 19:10:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:18.729 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:03:18.729 ************************************ 00:03:18.729 END TEST per_node_1G_alloc 00:03:18.729 ************************************ 00:03:18.989 19:10:05 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:18.989 19:10:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.989 19:10:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.989 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:03:18.989 ************************************ 00:03:18.989 START TEST even_2G_alloc 00:03:18.989 ************************************ 00:03:18.989 19:10:05 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:03:18.989 19:10:05 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:18.989 19:10:05 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:18.989 19:10:05 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:18.989 19:10:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.989 19:10:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.989 19:10:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.989 19:10:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.989 19:10:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.989 19:10:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.989 19:10:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.989 19:10:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:18.989 19:10:05 -- setup/hugepages.sh@83 -- # : 512 00:03:18.989 19:10:05 -- setup/hugepages.sh@84 -- # : 1 00:03:18.989 19:10:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:18.989 19:10:05 -- setup/hugepages.sh@83 -- # : 0 00:03:18.989 19:10:05 -- setup/hugepages.sh@84 -- # : 0 00:03:18.989 19:10:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.989 19:10:05 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:18.989 19:10:05 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:18.989 19:10:05 -- setup/hugepages.sh@153 -- # setup output 00:03:18.989 19:10:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.989 19:10:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:22.275 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.275 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:22.275 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:22.275 19:10:09 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:22.275 19:10:09 -- setup/hugepages.sh@89 -- # local node 00:03:22.275 19:10:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.275 19:10:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.275 19:10:09 -- setup/hugepages.sh@92 -- # local surp 00:03:22.275 19:10:09 -- setup/hugepages.sh@93 -- # local resv 00:03:22.275 19:10:09 -- setup/hugepages.sh@94 -- # local anon 00:03:22.275 19:10:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.275 19:10:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.275 19:10:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.275 19:10:09 -- setup/common.sh@18 -- # local node= 00:03:22.275 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.275 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.275 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.275 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.275 19:10:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.275 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.275 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41127564 kB' 'MemAvailable: 45861132 kB' 'Buffers: 14584 kB' 'Cached: 14547384 kB' 'SwapCached: 0 kB' 'Active: 10985892 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953248 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518252 kB' 'Mapped: 190344 kB' 'Shmem: 9438276 kB' 'KReclaimable: 213636 kB' 'Slab: 618608 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 404972 kB' 'KernelStack: 16496 kB' 'PageTables: 8092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11232412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.275 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.275 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.276 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.276 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.276 19:10:09 -- setup/common.sh@33 -- # echo 0 00:03:22.276 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.276 19:10:09 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.276 19:10:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.276 19:10:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.276 19:10:09 -- setup/common.sh@18 -- # local node= 00:03:22.276 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.276 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.276 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.276 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.276 19:10:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.276 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.276 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.277 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41128436 kB' 'MemAvailable: 45862004 kB' 'Buffers: 14584 kB' 'Cached: 14547388 kB' 'SwapCached: 0 kB' 'Active: 10986216 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953572 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518608 kB' 'Mapped: 190264 kB' 'Shmem: 9438280 kB' 'KReclaimable: 213636 kB' 'Slab: 618544 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 404908 kB' 'KernelStack: 16480 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11232424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.277 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.277 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.539 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.539 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.540 19:10:09 -- setup/common.sh@33 -- # echo 0 00:03:22.540 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.540 19:10:09 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.540 19:10:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.540 19:10:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.540 19:10:09 -- setup/common.sh@18 -- # local node= 00:03:22.540 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.540 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.540 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.540 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.540 19:10:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.540 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.540 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41128436 kB' 'MemAvailable: 45862004 kB' 'Buffers: 14584 kB' 'Cached: 14547400 kB' 'SwapCached: 0 kB' 'Active: 10985796 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953152 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518172 kB' 'Mapped: 190264 kB' 'Shmem: 9438292 kB' 'KReclaimable: 213636 kB' 'Slab: 618544 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 404908 kB' 'KernelStack: 16464 kB' 'PageTables: 7980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11232440 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.540 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.540 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.541 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.541 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.541 19:10:09 -- setup/common.sh@33 -- # echo 0 00:03:22.542 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.542 19:10:09 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.542 19:10:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.542 nr_hugepages=1024 00:03:22.542 19:10:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.542 resv_hugepages=0 00:03:22.542 19:10:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.542 surplus_hugepages=0 00:03:22.542 19:10:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.542 anon_hugepages=0 00:03:22.542 19:10:09 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.542 19:10:09 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.542 19:10:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.542 19:10:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.542 19:10:09 -- setup/common.sh@18 -- # local node= 00:03:22.542 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.542 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.542 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.542 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.542 19:10:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.542 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.542 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41128436 kB' 'MemAvailable: 45862004 kB' 'Buffers: 14584 kB' 'Cached: 14547400 kB' 'SwapCached: 0 kB' 'Active: 10985796 kB' 'Inactive: 4091048 kB' 'Active(anon): 9953152 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518172 kB' 'Mapped: 190264 kB' 'Shmem: 9438292 kB' 'KReclaimable: 213636 kB' 'Slab: 618544 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 404908 kB' 'KernelStack: 16464 kB' 'PageTables: 7980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11232456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.542 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.542 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.543 19:10:09 -- setup/common.sh@33 -- # echo 1024 00:03:22.543 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.543 19:10:09 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.543 19:10:09 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.543 19:10:09 -- setup/hugepages.sh@27 -- # local node 00:03:22.543 19:10:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.543 19:10:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:22.543 19:10:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.543 19:10:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:22.543 19:10:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.543 19:10:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.543 19:10:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.543 19:10:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.543 19:10:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.543 19:10:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.543 19:10:09 -- setup/common.sh@18 -- # local node=0 00:03:22.543 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.543 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.543 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.543 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.543 19:10:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.543 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.543 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 16801304 kB' 'MemUsed: 15785744 kB' 'SwapCached: 0 kB' 'Active: 9522636 kB' 'Inactive: 3929180 kB' 'Active(anon): 9108052 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100360 kB' 'Mapped: 127020 kB' 'AnonPages: 354720 kB' 'Shmem: 8756596 kB' 'KernelStack: 9192 kB' 'PageTables: 5052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 365656 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237056 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.543 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.543 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.544 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.544 19:10:09 -- setup/common.sh@33 -- # echo 0 00:03:22.544 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.544 19:10:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.544 19:10:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.544 19:10:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.544 19:10:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:22.544 19:10:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.544 19:10:09 -- setup/common.sh@18 -- # local node=1 00:03:22.544 19:10:09 -- setup/common.sh@19 -- # local var val 00:03:22.544 19:10:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.544 19:10:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.544 19:10:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:22.544 19:10:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:22.544 19:10:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.544 19:10:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.544 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708556 kB' 'MemFree: 24326732 kB' 'MemUsed: 3381824 kB' 'SwapCached: 0 kB' 'Active: 1463280 kB' 'Inactive: 161868 kB' 'Active(anon): 845220 kB' 'Inactive(anon): 0 kB' 'Active(file): 618060 kB' 'Inactive(file): 161868 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1461664 kB' 'Mapped: 63244 kB' 'AnonPages: 163572 kB' 'Shmem: 681736 kB' 'KernelStack: 7288 kB' 'PageTables: 2976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85036 kB' 'Slab: 252888 kB' 'SReclaimable: 85036 kB' 'SUnreclaim: 167852 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.545 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.545 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.546 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.546 19:10:09 -- setup/common.sh@32 -- # continue 00:03:22.546 19:10:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.546 19:10:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.546 19:10:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.546 19:10:09 -- setup/common.sh@33 -- # echo 0 00:03:22.546 19:10:09 -- setup/common.sh@33 -- # return 0 00:03:22.546 19:10:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.546 19:10:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.546 19:10:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.546 19:10:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.546 19:10:09 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:22.546 node0=512 expecting 512 00:03:22.546 19:10:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.546 19:10:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.546 19:10:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.546 19:10:09 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:22.546 node1=512 expecting 512 00:03:22.546 19:10:09 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:22.546 00:03:22.546 real 0m3.515s 00:03:22.546 user 0m1.373s 00:03:22.546 sys 0m2.222s 00:03:22.546 19:10:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:22.546 19:10:09 -- common/autotest_common.sh@10 -- # set +x 00:03:22.546 ************************************ 00:03:22.546 END TEST even_2G_alloc 00:03:22.546 ************************************ 00:03:22.546 19:10:09 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:22.546 19:10:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.546 19:10:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.546 19:10:09 -- common/autotest_common.sh@10 -- # set +x 00:03:22.804 ************************************ 00:03:22.804 START TEST odd_alloc 00:03:22.804 ************************************ 00:03:22.804 19:10:09 -- common/autotest_common.sh@1111 -- # odd_alloc 00:03:22.804 19:10:09 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:22.804 19:10:09 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:22.804 19:10:09 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:22.804 19:10:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:22.804 19:10:09 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:22.804 19:10:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.804 19:10:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:22.804 19:10:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.804 19:10:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.804 19:10:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.804 19:10:09 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:22.804 19:10:09 -- setup/hugepages.sh@83 -- # : 513 00:03:22.804 19:10:09 -- setup/hugepages.sh@84 -- # : 1 00:03:22.804 19:10:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:22.804 19:10:09 -- setup/hugepages.sh@83 -- # : 0 00:03:22.804 19:10:09 -- setup/hugepages.sh@84 -- # : 0 00:03:22.804 19:10:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.804 19:10:09 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:22.804 19:10:09 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:22.804 19:10:09 -- setup/hugepages.sh@160 -- # setup output 00:03:22.804 19:10:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.804 19:10:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:26.090 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.091 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.091 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.091 19:10:12 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:26.091 19:10:12 -- setup/hugepages.sh@89 -- # local node 00:03:26.091 19:10:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.091 19:10:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.091 19:10:12 -- setup/hugepages.sh@92 -- # local surp 00:03:26.091 19:10:12 -- setup/hugepages.sh@93 -- # local resv 00:03:26.091 19:10:12 -- setup/hugepages.sh@94 -- # local anon 00:03:26.091 19:10:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.091 19:10:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.091 19:10:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.091 19:10:12 -- setup/common.sh@18 -- # local node= 00:03:26.091 19:10:12 -- setup/common.sh@19 -- # local var val 00:03:26.091 19:10:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.091 19:10:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.091 19:10:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.091 19:10:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.091 19:10:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.091 19:10:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41124148 kB' 'MemAvailable: 45857716 kB' 'Buffers: 14584 kB' 'Cached: 14547496 kB' 'SwapCached: 0 kB' 'Active: 10988888 kB' 'Inactive: 4091048 kB' 'Active(anon): 9956244 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521180 kB' 'Mapped: 190372 kB' 'Shmem: 9438388 kB' 'KReclaimable: 213636 kB' 'Slab: 619128 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405492 kB' 'KernelStack: 16512 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 11232480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.091 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.091 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.092 19:10:12 -- setup/common.sh@33 -- # echo 0 00:03:26.092 19:10:12 -- setup/common.sh@33 -- # return 0 00:03:26.092 19:10:12 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.092 19:10:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.092 19:10:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.092 19:10:12 -- setup/common.sh@18 -- # local node= 00:03:26.092 19:10:12 -- setup/common.sh@19 -- # local var val 00:03:26.092 19:10:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.092 19:10:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.092 19:10:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.092 19:10:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.092 19:10:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.092 19:10:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41124640 kB' 'MemAvailable: 45858208 kB' 'Buffers: 14584 kB' 'Cached: 14547500 kB' 'SwapCached: 0 kB' 'Active: 10988308 kB' 'Inactive: 4091048 kB' 'Active(anon): 9955664 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520680 kB' 'Mapped: 190288 kB' 'Shmem: 9438392 kB' 'KReclaimable: 213636 kB' 'Slab: 619088 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405452 kB' 'KernelStack: 16480 kB' 'PageTables: 8028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 11232488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203028 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.092 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.092 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.093 19:10:12 -- setup/common.sh@33 -- # echo 0 00:03:26.093 19:10:12 -- setup/common.sh@33 -- # return 0 00:03:26.093 19:10:12 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.093 19:10:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.093 19:10:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.093 19:10:12 -- setup/common.sh@18 -- # local node= 00:03:26.093 19:10:12 -- setup/common.sh@19 -- # local var val 00:03:26.093 19:10:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.093 19:10:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.093 19:10:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.093 19:10:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.093 19:10:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.093 19:10:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41124640 kB' 'MemAvailable: 45858208 kB' 'Buffers: 14584 kB' 'Cached: 14547500 kB' 'SwapCached: 0 kB' 'Active: 10988308 kB' 'Inactive: 4091048 kB' 'Active(anon): 9955664 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520680 kB' 'Mapped: 190288 kB' 'Shmem: 9438392 kB' 'KReclaimable: 213636 kB' 'Slab: 619088 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405452 kB' 'KernelStack: 16480 kB' 'PageTables: 8028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 11232504 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203028 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.093 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.093 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.094 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.094 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.095 19:10:12 -- setup/common.sh@33 -- # echo 0 00:03:26.095 19:10:12 -- setup/common.sh@33 -- # return 0 00:03:26.095 19:10:12 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.095 19:10:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:26.095 nr_hugepages=1025 00:03:26.095 19:10:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.095 resv_hugepages=0 00:03:26.095 19:10:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.095 surplus_hugepages=0 00:03:26.095 19:10:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.095 anon_hugepages=0 00:03:26.095 19:10:12 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.095 19:10:12 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:26.095 19:10:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.095 19:10:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.095 19:10:12 -- setup/common.sh@18 -- # local node= 00:03:26.095 19:10:12 -- setup/common.sh@19 -- # local var val 00:03:26.095 19:10:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.095 19:10:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.095 19:10:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.095 19:10:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.095 19:10:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.095 19:10:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41124968 kB' 'MemAvailable: 45858536 kB' 'Buffers: 14584 kB' 'Cached: 14547536 kB' 'SwapCached: 0 kB' 'Active: 10988020 kB' 'Inactive: 4091048 kB' 'Active(anon): 9955376 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520300 kB' 'Mapped: 190288 kB' 'Shmem: 9438428 kB' 'KReclaimable: 213636 kB' 'Slab: 619088 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405452 kB' 'KernelStack: 16464 kB' 'PageTables: 7976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 11232520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203028 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.095 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.095 19:10:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.096 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.096 19:10:13 -- setup/common.sh@33 -- # echo 1025 00:03:26.096 19:10:13 -- setup/common.sh@33 -- # return 0 00:03:26.096 19:10:13 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.096 19:10:13 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.096 19:10:13 -- setup/hugepages.sh@27 -- # local node 00:03:26.096 19:10:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.096 19:10:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.096 19:10:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.096 19:10:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:26.096 19:10:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.096 19:10:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.096 19:10:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.096 19:10:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.096 19:10:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.096 19:10:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.096 19:10:13 -- setup/common.sh@18 -- # local node=0 00:03:26.096 19:10:13 -- setup/common.sh@19 -- # local var val 00:03:26.096 19:10:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.096 19:10:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.096 19:10:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.096 19:10:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.096 19:10:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.096 19:10:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.096 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 16793348 kB' 'MemUsed: 15793700 kB' 'SwapCached: 0 kB' 'Active: 9523940 kB' 'Inactive: 3929180 kB' 'Active(anon): 9109356 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100384 kB' 'Mapped: 127020 kB' 'AnonPages: 355976 kB' 'Shmem: 8756620 kB' 'KernelStack: 9144 kB' 'PageTables: 4964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 365880 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237280 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.097 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.097 19:10:13 -- setup/common.sh@33 -- # echo 0 00:03:26.097 19:10:13 -- setup/common.sh@33 -- # return 0 00:03:26.097 19:10:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.097 19:10:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.097 19:10:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.097 19:10:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:26.097 19:10:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.097 19:10:13 -- setup/common.sh@18 -- # local node=1 00:03:26.097 19:10:13 -- setup/common.sh@19 -- # local var val 00:03:26.097 19:10:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.097 19:10:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.097 19:10:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:26.097 19:10:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:26.097 19:10:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.097 19:10:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.097 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708556 kB' 'MemFree: 24332028 kB' 'MemUsed: 3376528 kB' 'SwapCached: 0 kB' 'Active: 1464744 kB' 'Inactive: 161868 kB' 'Active(anon): 846684 kB' 'Inactive(anon): 0 kB' 'Active(file): 618060 kB' 'Inactive(file): 161868 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1461752 kB' 'Mapped: 63268 kB' 'AnonPages: 164976 kB' 'Shmem: 681824 kB' 'KernelStack: 7336 kB' 'PageTables: 3064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85036 kB' 'Slab: 253208 kB' 'SReclaimable: 85036 kB' 'SUnreclaim: 168172 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # continue 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.098 19:10:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.098 19:10:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.098 19:10:13 -- setup/common.sh@33 -- # echo 0 00:03:26.098 19:10:13 -- setup/common.sh@33 -- # return 0 00:03:26.098 19:10:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.098 19:10:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.098 19:10:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.098 19:10:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.098 19:10:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:26.098 node0=512 expecting 513 00:03:26.099 19:10:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.099 19:10:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.099 19:10:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.099 19:10:13 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:26.099 node1=513 expecting 512 00:03:26.099 19:10:13 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:26.099 00:03:26.099 real 0m3.423s 00:03:26.099 user 0m1.323s 00:03:26.099 sys 0m2.183s 00:03:26.099 19:10:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:26.099 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:03:26.099 ************************************ 00:03:26.099 END TEST odd_alloc 00:03:26.099 ************************************ 00:03:26.099 19:10:13 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:26.099 19:10:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.099 19:10:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.099 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:03:26.357 ************************************ 00:03:26.357 START TEST custom_alloc 00:03:26.357 ************************************ 00:03:26.357 19:10:13 -- common/autotest_common.sh@1111 -- # custom_alloc 00:03:26.357 19:10:13 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:26.357 19:10:13 -- setup/hugepages.sh@169 -- # local node 00:03:26.357 19:10:13 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:26.357 19:10:13 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:26.357 19:10:13 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:26.357 19:10:13 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:26.357 19:10:13 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.357 19:10:13 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.357 19:10:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.357 19:10:13 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.357 19:10:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.357 19:10:13 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.357 19:10:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.357 19:10:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.357 19:10:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.358 19:10:13 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.358 19:10:13 -- setup/hugepages.sh@83 -- # : 256 00:03:26.358 19:10:13 -- setup/hugepages.sh@84 -- # : 1 00:03:26.358 19:10:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.358 19:10:13 -- setup/hugepages.sh@83 -- # : 0 00:03:26.358 19:10:13 -- setup/hugepages.sh@84 -- # : 0 00:03:26.358 19:10:13 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:26.358 19:10:13 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:26.358 19:10:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:26.358 19:10:13 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:26.358 19:10:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.358 19:10:13 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.358 19:10:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.358 19:10:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.358 19:10:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.358 19:10:13 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.358 19:10:13 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.358 19:10:13 -- setup/hugepages.sh@78 -- # return 0 00:03:26.358 19:10:13 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:26.358 19:10:13 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.358 19:10:13 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.358 19:10:13 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.358 19:10:13 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.358 19:10:13 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:26.358 19:10:13 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.358 19:10:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.358 19:10:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.358 19:10:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.358 19:10:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.358 19:10:13 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:26.358 19:10:13 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.358 19:10:13 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.358 19:10:13 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.358 19:10:13 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:26.358 19:10:13 -- setup/hugepages.sh@78 -- # return 0 00:03:26.358 19:10:13 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:26.358 19:10:13 -- setup/hugepages.sh@187 -- # setup output 00:03:26.358 19:10:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.358 19:10:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:29.640 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.640 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:29.640 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:29.640 19:10:16 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:29.640 19:10:16 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:29.640 19:10:16 -- setup/hugepages.sh@89 -- # local node 00:03:29.640 19:10:16 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.640 19:10:16 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.640 19:10:16 -- setup/hugepages.sh@92 -- # local surp 00:03:29.640 19:10:16 -- setup/hugepages.sh@93 -- # local resv 00:03:29.640 19:10:16 -- setup/hugepages.sh@94 -- # local anon 00:03:29.640 19:10:16 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.640 19:10:16 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.640 19:10:16 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.640 19:10:16 -- setup/common.sh@18 -- # local node= 00:03:29.640 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.640 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.640 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.640 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.640 19:10:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.640 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.640 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 40086556 kB' 'MemAvailable: 44820124 kB' 'Buffers: 14584 kB' 'Cached: 14547620 kB' 'SwapCached: 0 kB' 'Active: 10989732 kB' 'Inactive: 4091048 kB' 'Active(anon): 9957088 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521300 kB' 'Mapped: 190424 kB' 'Shmem: 9438512 kB' 'KReclaimable: 213636 kB' 'Slab: 619188 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405552 kB' 'KernelStack: 16496 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 11233128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.640 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.640 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.641 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.641 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.641 19:10:16 -- setup/common.sh@33 -- # echo 0 00:03:29.641 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.641 19:10:16 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.641 19:10:16 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.641 19:10:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.641 19:10:16 -- setup/common.sh@18 -- # local node= 00:03:29.641 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.641 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.641 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.641 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.641 19:10:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.641 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.641 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.642 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 40087368 kB' 'MemAvailable: 44820936 kB' 'Buffers: 14584 kB' 'Cached: 14547624 kB' 'SwapCached: 0 kB' 'Active: 10988972 kB' 'Inactive: 4091048 kB' 'Active(anon): 9956328 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521004 kB' 'Mapped: 190328 kB' 'Shmem: 9438516 kB' 'KReclaimable: 213636 kB' 'Slab: 619172 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405536 kB' 'KernelStack: 16496 kB' 'PageTables: 8068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 11233140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.642 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.642 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.643 19:10:16 -- setup/common.sh@33 -- # echo 0 00:03:29.643 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.643 19:10:16 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.643 19:10:16 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.643 19:10:16 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.643 19:10:16 -- setup/common.sh@18 -- # local node= 00:03:29.643 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.643 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.643 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.643 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.643 19:10:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.643 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.643 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.643 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 40087368 kB' 'MemAvailable: 44820936 kB' 'Buffers: 14584 kB' 'Cached: 14547636 kB' 'SwapCached: 0 kB' 'Active: 10988548 kB' 'Inactive: 4091048 kB' 'Active(anon): 9955904 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520564 kB' 'Mapped: 190328 kB' 'Shmem: 9438528 kB' 'KReclaimable: 213636 kB' 'Slab: 619172 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405536 kB' 'KernelStack: 16480 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 11233156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.643 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.643 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.644 19:10:16 -- setup/common.sh@33 -- # echo 0 00:03:29.644 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.644 19:10:16 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.644 19:10:16 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:29.644 nr_hugepages=1536 00:03:29.644 19:10:16 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.644 resv_hugepages=0 00:03:29.644 19:10:16 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.644 surplus_hugepages=0 00:03:29.644 19:10:16 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.644 anon_hugepages=0 00:03:29.644 19:10:16 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.644 19:10:16 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:29.644 19:10:16 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.644 19:10:16 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.644 19:10:16 -- setup/common.sh@18 -- # local node= 00:03:29.644 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.644 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.644 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.644 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.644 19:10:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.644 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.644 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 40086360 kB' 'MemAvailable: 44819928 kB' 'Buffers: 14584 kB' 'Cached: 14547648 kB' 'SwapCached: 0 kB' 'Active: 10989496 kB' 'Inactive: 4091048 kB' 'Active(anon): 9956852 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521500 kB' 'Mapped: 190832 kB' 'Shmem: 9438540 kB' 'KReclaimable: 213636 kB' 'Slab: 619172 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405536 kB' 'KernelStack: 16464 kB' 'PageTables: 7968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 11234792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.644 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.644 19:10:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.645 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.645 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.646 19:10:16 -- setup/common.sh@33 -- # echo 1536 00:03:29.646 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.646 19:10:16 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.646 19:10:16 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.646 19:10:16 -- setup/hugepages.sh@27 -- # local node 00:03:29.646 19:10:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.646 19:10:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.646 19:10:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.646 19:10:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.646 19:10:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.646 19:10:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.646 19:10:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.646 19:10:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.646 19:10:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.646 19:10:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.646 19:10:16 -- setup/common.sh@18 -- # local node=0 00:03:29.646 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.646 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.646 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.646 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.646 19:10:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.646 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.646 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 16792716 kB' 'MemUsed: 15794332 kB' 'SwapCached: 0 kB' 'Active: 9530908 kB' 'Inactive: 3929180 kB' 'Active(anon): 9116324 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100412 kB' 'Mapped: 127536 kB' 'AnonPages: 362796 kB' 'Shmem: 8756648 kB' 'KernelStack: 9160 kB' 'PageTables: 5064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 365772 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237172 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.646 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.646 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@33 -- # echo 0 00:03:29.647 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.647 19:10:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.647 19:10:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.647 19:10:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.647 19:10:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.647 19:10:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.647 19:10:16 -- setup/common.sh@18 -- # local node=1 00:03:29.647 19:10:16 -- setup/common.sh@19 -- # local var val 00:03:29.647 19:10:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.647 19:10:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.647 19:10:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.647 19:10:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.647 19:10:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.647 19:10:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708556 kB' 'MemFree: 23285280 kB' 'MemUsed: 4423276 kB' 'SwapCached: 0 kB' 'Active: 1464220 kB' 'Inactive: 161868 kB' 'Active(anon): 846160 kB' 'Inactive(anon): 0 kB' 'Active(file): 618060 kB' 'Inactive(file): 161868 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1461848 kB' 'Mapped: 63296 kB' 'AnonPages: 164392 kB' 'Shmem: 681920 kB' 'KernelStack: 7352 kB' 'PageTables: 3056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 85036 kB' 'Slab: 253400 kB' 'SReclaimable: 85036 kB' 'SUnreclaim: 168364 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.647 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.647 19:10:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # continue 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.648 19:10:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.648 19:10:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.648 19:10:16 -- setup/common.sh@33 -- # echo 0 00:03:29.648 19:10:16 -- setup/common.sh@33 -- # return 0 00:03:29.648 19:10:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.648 19:10:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.648 19:10:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.648 19:10:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.648 19:10:16 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.648 node0=512 expecting 512 00:03:29.648 19:10:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.648 19:10:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.648 19:10:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.648 19:10:16 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:29.648 node1=1024 expecting 1024 00:03:29.648 19:10:16 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:29.648 00:03:29.648 real 0m3.300s 00:03:29.648 user 0m1.277s 00:03:29.648 sys 0m2.084s 00:03:29.648 19:10:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:29.648 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:03:29.648 ************************************ 00:03:29.648 END TEST custom_alloc 00:03:29.648 ************************************ 00:03:29.648 19:10:16 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:29.648 19:10:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.648 19:10:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.648 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:03:29.905 ************************************ 00:03:29.905 START TEST no_shrink_alloc 00:03:29.905 ************************************ 00:03:29.905 19:10:16 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:03:29.905 19:10:16 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:29.905 19:10:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:29.905 19:10:16 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:29.905 19:10:16 -- setup/hugepages.sh@51 -- # shift 00:03:29.905 19:10:16 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:29.905 19:10:16 -- setup/hugepages.sh@52 -- # local node_ids 00:03:29.905 19:10:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.905 19:10:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:29.905 19:10:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:29.905 19:10:16 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:29.905 19:10:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.905 19:10:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:29.905 19:10:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.905 19:10:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.905 19:10:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.906 19:10:16 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:29.906 19:10:16 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:29.906 19:10:16 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:29.906 19:10:16 -- setup/hugepages.sh@73 -- # return 0 00:03:29.906 19:10:16 -- setup/hugepages.sh@198 -- # setup output 00:03:29.906 19:10:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.906 19:10:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:32.436 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.436 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:32.436 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:32.696 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:32.696 19:10:19 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:32.696 19:10:19 -- setup/hugepages.sh@89 -- # local node 00:03:32.696 19:10:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.696 19:10:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.696 19:10:19 -- setup/hugepages.sh@92 -- # local surp 00:03:32.696 19:10:19 -- setup/hugepages.sh@93 -- # local resv 00:03:32.696 19:10:19 -- setup/hugepages.sh@94 -- # local anon 00:03:32.696 19:10:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.696 19:10:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.696 19:10:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.696 19:10:19 -- setup/common.sh@18 -- # local node= 00:03:32.696 19:10:19 -- setup/common.sh@19 -- # local var val 00:03:32.696 19:10:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.696 19:10:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.696 19:10:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.696 19:10:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.696 19:10:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.696 19:10:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.696 19:10:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41116652 kB' 'MemAvailable: 45850220 kB' 'Buffers: 14584 kB' 'Cached: 14547728 kB' 'SwapCached: 0 kB' 'Active: 10990784 kB' 'Inactive: 4091048 kB' 'Active(anon): 9958140 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 522300 kB' 'Mapped: 190456 kB' 'Shmem: 9438620 kB' 'KReclaimable: 213636 kB' 'Slab: 619272 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405636 kB' 'KernelStack: 16496 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11233792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203188 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.696 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.696 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.697 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.697 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.698 19:10:19 -- setup/common.sh@33 -- # echo 0 00:03:32.698 19:10:19 -- setup/common.sh@33 -- # return 0 00:03:32.698 19:10:19 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.698 19:10:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.698 19:10:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.698 19:10:19 -- setup/common.sh@18 -- # local node= 00:03:32.698 19:10:19 -- setup/common.sh@19 -- # local var val 00:03:32.698 19:10:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.698 19:10:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.698 19:10:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.698 19:10:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.698 19:10:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.698 19:10:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41116252 kB' 'MemAvailable: 45849820 kB' 'Buffers: 14584 kB' 'Cached: 14547732 kB' 'SwapCached: 0 kB' 'Active: 10990124 kB' 'Inactive: 4091048 kB' 'Active(anon): 9957480 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521620 kB' 'Mapped: 190444 kB' 'Shmem: 9438624 kB' 'KReclaimable: 213636 kB' 'Slab: 619272 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405636 kB' 'KernelStack: 16480 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11233800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203188 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.698 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.698 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.699 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.699 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.700 19:10:19 -- setup/common.sh@33 -- # echo 0 00:03:32.700 19:10:19 -- setup/common.sh@33 -- # return 0 00:03:32.700 19:10:19 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.700 19:10:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.700 19:10:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.700 19:10:19 -- setup/common.sh@18 -- # local node= 00:03:32.700 19:10:19 -- setup/common.sh@19 -- # local var val 00:03:32.700 19:10:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.700 19:10:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.700 19:10:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.700 19:10:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.700 19:10:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.700 19:10:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41117176 kB' 'MemAvailable: 45850744 kB' 'Buffers: 14584 kB' 'Cached: 14547744 kB' 'SwapCached: 0 kB' 'Active: 10989628 kB' 'Inactive: 4091048 kB' 'Active(anon): 9956984 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521624 kB' 'Mapped: 190360 kB' 'Shmem: 9438636 kB' 'KReclaimable: 213636 kB' 'Slab: 619276 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405640 kB' 'KernelStack: 16464 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11234908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203172 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.700 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.700 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.701 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.701 19:10:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.702 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.702 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.961 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.961 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.962 19:10:19 -- setup/common.sh@33 -- # echo 0 00:03:32.962 19:10:19 -- setup/common.sh@33 -- # return 0 00:03:32.962 19:10:19 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.962 19:10:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:32.962 nr_hugepages=1024 00:03:32.962 19:10:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.962 resv_hugepages=0 00:03:32.962 19:10:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.962 surplus_hugepages=0 00:03:32.962 19:10:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.962 anon_hugepages=0 00:03:32.962 19:10:19 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.962 19:10:19 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:32.962 19:10:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.962 19:10:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.962 19:10:19 -- setup/common.sh@18 -- # local node= 00:03:32.962 19:10:19 -- setup/common.sh@19 -- # local var val 00:03:32.962 19:10:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.962 19:10:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.962 19:10:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.962 19:10:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.962 19:10:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.962 19:10:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41114604 kB' 'MemAvailable: 45848172 kB' 'Buffers: 14584 kB' 'Cached: 14547760 kB' 'SwapCached: 0 kB' 'Active: 10994796 kB' 'Inactive: 4091048 kB' 'Active(anon): 9962152 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 526784 kB' 'Mapped: 190864 kB' 'Shmem: 9438652 kB' 'KReclaimable: 213636 kB' 'Slab: 619276 kB' 'SReclaimable: 213636 kB' 'SUnreclaim: 405640 kB' 'KernelStack: 16480 kB' 'PageTables: 8044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11239952 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203156 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.962 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.962 19:10:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.963 19:10:19 -- setup/common.sh@33 -- # echo 1024 00:03:32.963 19:10:19 -- setup/common.sh@33 -- # return 0 00:03:32.963 19:10:19 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.963 19:10:19 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.963 19:10:19 -- setup/hugepages.sh@27 -- # local node 00:03:32.963 19:10:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.963 19:10:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:32.963 19:10:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.963 19:10:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:32.963 19:10:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.963 19:10:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.963 19:10:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.963 19:10:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.963 19:10:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.963 19:10:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.963 19:10:19 -- setup/common.sh@18 -- # local node=0 00:03:32.963 19:10:19 -- setup/common.sh@19 -- # local var val 00:03:32.963 19:10:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.963 19:10:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.963 19:10:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.963 19:10:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.963 19:10:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.963 19:10:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 15734324 kB' 'MemUsed: 16852724 kB' 'SwapCached: 0 kB' 'Active: 9526388 kB' 'Inactive: 3929180 kB' 'Active(anon): 9111804 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100496 kB' 'Mapped: 127040 kB' 'AnonPages: 358296 kB' 'Shmem: 8756732 kB' 'KernelStack: 9160 kB' 'PageTables: 5088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128600 kB' 'Slab: 365892 kB' 'SReclaimable: 128600 kB' 'SUnreclaim: 237292 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.963 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.963 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # continue 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.964 19:10:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.964 19:10:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.964 19:10:19 -- setup/common.sh@33 -- # echo 0 00:03:32.964 19:10:19 -- setup/common.sh@33 -- # return 0 00:03:32.964 19:10:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.964 19:10:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.964 19:10:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.964 19:10:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.964 19:10:19 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:32.964 node0=1024 expecting 1024 00:03:32.964 19:10:19 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:32.964 19:10:19 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:32.964 19:10:19 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:32.964 19:10:19 -- setup/hugepages.sh@202 -- # setup output 00:03:32.964 19:10:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.964 19:10:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:36.247 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:36.247 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:36.247 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:36.247 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:36.247 19:10:22 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:36.247 19:10:22 -- setup/hugepages.sh@89 -- # local node 00:03:36.247 19:10:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:36.247 19:10:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:36.247 19:10:22 -- setup/hugepages.sh@92 -- # local surp 00:03:36.247 19:10:22 -- setup/hugepages.sh@93 -- # local resv 00:03:36.247 19:10:22 -- setup/hugepages.sh@94 -- # local anon 00:03:36.247 19:10:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:36.247 19:10:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:36.247 19:10:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:36.247 19:10:22 -- setup/common.sh@18 -- # local node= 00:03:36.248 19:10:22 -- setup/common.sh@19 -- # local var val 00:03:36.248 19:10:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.248 19:10:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.248 19:10:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.248 19:10:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.248 19:10:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.248 19:10:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41120392 kB' 'MemAvailable: 45853944 kB' 'Buffers: 14584 kB' 'Cached: 14547824 kB' 'SwapCached: 0 kB' 'Active: 10992236 kB' 'Inactive: 4091048 kB' 'Active(anon): 9959592 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 524672 kB' 'Mapped: 190900 kB' 'Shmem: 9438716 kB' 'KReclaimable: 213604 kB' 'Slab: 618832 kB' 'SReclaimable: 213604 kB' 'SUnreclaim: 405228 kB' 'KernelStack: 16512 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11240464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203128 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.248 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.248 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.249 19:10:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.249 19:10:22 -- setup/common.sh@33 -- # echo 0 00:03:36.249 19:10:22 -- setup/common.sh@33 -- # return 0 00:03:36.249 19:10:22 -- setup/hugepages.sh@97 -- # anon=0 00:03:36.249 19:10:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:36.249 19:10:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:36.249 19:10:22 -- setup/common.sh@18 -- # local node= 00:03:36.249 19:10:22 -- setup/common.sh@19 -- # local var val 00:03:36.249 19:10:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.249 19:10:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.249 19:10:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.249 19:10:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.249 19:10:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.249 19:10:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.249 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41120584 kB' 'MemAvailable: 45854136 kB' 'Buffers: 14584 kB' 'Cached: 14547828 kB' 'SwapCached: 0 kB' 'Active: 10987316 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954672 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519176 kB' 'Mapped: 190368 kB' 'Shmem: 9438720 kB' 'KReclaimable: 213604 kB' 'Slab: 618816 kB' 'SReclaimable: 213604 kB' 'SUnreclaim: 405212 kB' 'KernelStack: 16496 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11234356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:22 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.250 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.250 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.251 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.251 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.252 19:10:23 -- setup/common.sh@33 -- # echo 0 00:03:36.252 19:10:23 -- setup/common.sh@33 -- # return 0 00:03:36.252 19:10:23 -- setup/hugepages.sh@99 -- # surp=0 00:03:36.252 19:10:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:36.252 19:10:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:36.252 19:10:23 -- setup/common.sh@18 -- # local node= 00:03:36.252 19:10:23 -- setup/common.sh@19 -- # local var val 00:03:36.252 19:10:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.252 19:10:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.252 19:10:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.252 19:10:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.252 19:10:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.252 19:10:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41121084 kB' 'MemAvailable: 45854636 kB' 'Buffers: 14584 kB' 'Cached: 14547840 kB' 'SwapCached: 0 kB' 'Active: 10986944 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954300 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518812 kB' 'Mapped: 190368 kB' 'Shmem: 9438732 kB' 'KReclaimable: 213604 kB' 'Slab: 618880 kB' 'SReclaimable: 213604 kB' 'SUnreclaim: 405276 kB' 'KernelStack: 16464 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11234368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203108 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.252 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.252 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.253 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.253 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.254 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.254 19:10:23 -- setup/common.sh@33 -- # echo 0 00:03:36.254 19:10:23 -- setup/common.sh@33 -- # return 0 00:03:36.254 19:10:23 -- setup/hugepages.sh@100 -- # resv=0 00:03:36.254 19:10:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:36.254 nr_hugepages=1024 00:03:36.254 19:10:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:36.254 resv_hugepages=0 00:03:36.254 19:10:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:36.254 surplus_hugepages=0 00:03:36.254 19:10:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:36.254 anon_hugepages=0 00:03:36.254 19:10:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:36.254 19:10:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:36.254 19:10:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:36.254 19:10:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:36.254 19:10:23 -- setup/common.sh@18 -- # local node= 00:03:36.254 19:10:23 -- setup/common.sh@19 -- # local var val 00:03:36.254 19:10:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.254 19:10:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.254 19:10:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.254 19:10:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.254 19:10:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.254 19:10:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.254 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 41120832 kB' 'MemAvailable: 45854384 kB' 'Buffers: 14584 kB' 'Cached: 14547852 kB' 'SwapCached: 0 kB' 'Active: 10987228 kB' 'Inactive: 4091048 kB' 'Active(anon): 9954584 kB' 'Inactive(anon): 0 kB' 'Active(file): 1032644 kB' 'Inactive(file): 4091048 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519120 kB' 'Mapped: 190368 kB' 'Shmem: 9438744 kB' 'KReclaimable: 213604 kB' 'Slab: 618880 kB' 'SReclaimable: 213604 kB' 'SUnreclaim: 405276 kB' 'KernelStack: 16496 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 11234384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 52160 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1086920 kB' 'DirectMap2M: 27949056 kB' 'DirectMap1G: 39845888 kB' 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.255 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.255 19:10:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.256 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.256 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.257 19:10:23 -- setup/common.sh@33 -- # echo 1024 00:03:36.257 19:10:23 -- setup/common.sh@33 -- # return 0 00:03:36.257 19:10:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:36.257 19:10:23 -- setup/hugepages.sh@112 -- # get_nodes 00:03:36.257 19:10:23 -- setup/hugepages.sh@27 -- # local node 00:03:36.257 19:10:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:36.257 19:10:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:36.257 19:10:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:36.257 19:10:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:36.257 19:10:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:36.257 19:10:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:36.257 19:10:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:36.257 19:10:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:36.257 19:10:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:36.257 19:10:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:36.257 19:10:23 -- setup/common.sh@18 -- # local node=0 00:03:36.257 19:10:23 -- setup/common.sh@19 -- # local var val 00:03:36.257 19:10:23 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.257 19:10:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.257 19:10:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:36.257 19:10:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:36.257 19:10:23 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.257 19:10:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587048 kB' 'MemFree: 15745164 kB' 'MemUsed: 16841884 kB' 'SwapCached: 0 kB' 'Active: 9524980 kB' 'Inactive: 3929180 kB' 'Active(anon): 9110396 kB' 'Inactive(anon): 0 kB' 'Active(file): 414584 kB' 'Inactive(file): 3929180 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 13100572 kB' 'Mapped: 127040 kB' 'AnonPages: 356844 kB' 'Shmem: 8756808 kB' 'KernelStack: 9192 kB' 'PageTables: 5132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 128568 kB' 'Slab: 365488 kB' 'SReclaimable: 128568 kB' 'SUnreclaim: 236920 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.257 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.257 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.258 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.258 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # continue 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.259 19:10:23 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.259 19:10:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.259 19:10:23 -- setup/common.sh@33 -- # echo 0 00:03:36.259 19:10:23 -- setup/common.sh@33 -- # return 0 00:03:36.259 19:10:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:36.259 19:10:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:36.259 19:10:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:36.259 19:10:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:36.259 19:10:23 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:36.259 node0=1024 expecting 1024 00:03:36.259 19:10:23 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:36.259 00:03:36.259 real 0m6.328s 00:03:36.259 user 0m2.304s 00:03:36.259 sys 0m4.121s 00:03:36.259 19:10:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:36.259 19:10:23 -- common/autotest_common.sh@10 -- # set +x 00:03:36.259 ************************************ 00:03:36.259 END TEST no_shrink_alloc 00:03:36.259 ************************************ 00:03:36.259 19:10:23 -- setup/hugepages.sh@217 -- # clear_hp 00:03:36.259 19:10:23 -- setup/hugepages.sh@37 -- # local node hp 00:03:36.259 19:10:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:36.259 19:10:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.259 19:10:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.259 19:10:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.259 19:10:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.259 19:10:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:36.259 19:10:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.259 19:10:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.259 19:10:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.259 19:10:23 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.259 19:10:23 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:36.259 19:10:23 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:36.259 00:03:36.259 real 0m26.685s 00:03:36.259 user 0m9.482s 00:03:36.259 sys 0m15.770s 00:03:36.259 19:10:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:36.259 19:10:23 -- common/autotest_common.sh@10 -- # set +x 00:03:36.259 ************************************ 00:03:36.259 END TEST hugepages 00:03:36.259 ************************************ 00:03:36.259 19:10:23 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:36.259 19:10:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:36.259 19:10:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:36.259 19:10:23 -- common/autotest_common.sh@10 -- # set +x 00:03:36.563 ************************************ 00:03:36.564 START TEST driver 00:03:36.564 ************************************ 00:03:36.564 19:10:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:36.564 * Looking for test storage... 00:03:36.564 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:36.564 19:10:23 -- setup/driver.sh@68 -- # setup reset 00:03:36.564 19:10:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:36.564 19:10:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:41.853 19:10:27 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:41.853 19:10:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.853 19:10:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.853 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:03:41.853 ************************************ 00:03:41.853 START TEST guess_driver 00:03:41.853 ************************************ 00:03:41.853 19:10:28 -- common/autotest_common.sh@1111 -- # guess_driver 00:03:41.853 19:10:28 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:41.853 19:10:28 -- setup/driver.sh@47 -- # local fail=0 00:03:41.853 19:10:28 -- setup/driver.sh@49 -- # pick_driver 00:03:41.853 19:10:28 -- setup/driver.sh@36 -- # vfio 00:03:41.853 19:10:28 -- setup/driver.sh@21 -- # local iommu_grups 00:03:41.853 19:10:28 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:41.853 19:10:28 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:41.853 19:10:28 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:41.853 19:10:28 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:41.853 19:10:28 -- setup/driver.sh@29 -- # (( 163 > 0 )) 00:03:41.853 19:10:28 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:41.853 19:10:28 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:41.853 19:10:28 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:41.853 19:10:28 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:41.853 19:10:28 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:41.853 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:41.853 19:10:28 -- setup/driver.sh@30 -- # return 0 00:03:41.853 19:10:28 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:41.853 19:10:28 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:41.853 19:10:28 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:41.853 19:10:28 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:41.853 Looking for driver=vfio-pci 00:03:41.853 19:10:28 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:41.853 19:10:28 -- setup/driver.sh@45 -- # setup output config 00:03:41.853 19:10:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.853 19:10:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:43.758 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:43.758 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:43.758 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.016 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.016 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.016 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.016 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.016 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.016 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.016 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.016 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.016 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.016 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.017 19:10:30 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.017 19:10:30 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.017 19:10:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:45.919 19:10:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:45.919 19:10:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:45.919 19:10:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:45.919 19:10:32 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:45.919 19:10:32 -- setup/driver.sh@65 -- # setup reset 00:03:45.919 19:10:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:45.919 19:10:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:50.104 00:03:50.104 real 0m8.905s 00:03:50.104 user 0m2.055s 00:03:50.104 sys 0m4.218s 00:03:50.104 19:10:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:50.104 19:10:36 -- common/autotest_common.sh@10 -- # set +x 00:03:50.104 ************************************ 00:03:50.104 END TEST guess_driver 00:03:50.104 ************************************ 00:03:50.104 00:03:50.104 real 0m13.644s 00:03:50.104 user 0m3.443s 00:03:50.104 sys 0m6.820s 00:03:50.104 19:10:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:50.104 19:10:36 -- common/autotest_common.sh@10 -- # set +x 00:03:50.104 ************************************ 00:03:50.104 END TEST driver 00:03:50.104 ************************************ 00:03:50.104 19:10:37 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:50.104 19:10:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:50.104 19:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:50.104 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:03:50.361 ************************************ 00:03:50.361 START TEST devices 00:03:50.361 ************************************ 00:03:50.361 19:10:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:50.361 * Looking for test storage... 00:03:50.361 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:50.361 19:10:37 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:50.361 19:10:37 -- setup/devices.sh@192 -- # setup reset 00:03:50.361 19:10:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:50.361 19:10:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:53.643 19:10:40 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:53.643 19:10:40 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:53.643 19:10:40 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:53.643 19:10:40 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:53.643 19:10:40 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:53.643 19:10:40 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:53.643 19:10:40 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:53.643 19:10:40 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:53.643 19:10:40 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:53.643 19:10:40 -- setup/devices.sh@196 -- # blocks=() 00:03:53.643 19:10:40 -- setup/devices.sh@196 -- # declare -a blocks 00:03:53.643 19:10:40 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:53.643 19:10:40 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:53.643 19:10:40 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:53.643 19:10:40 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:53.643 19:10:40 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:53.643 19:10:40 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:53.643 19:10:40 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:03:53.643 19:10:40 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:03:53.643 19:10:40 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:53.643 19:10:40 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:53.643 19:10:40 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:53.643 No valid GPT data, bailing 00:03:53.643 19:10:40 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:53.643 19:10:40 -- scripts/common.sh@391 -- # pt= 00:03:53.643 19:10:40 -- scripts/common.sh@392 -- # return 1 00:03:53.644 19:10:40 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:53.644 19:10:40 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:53.644 19:10:40 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:53.644 19:10:40 -- setup/common.sh@80 -- # echo 1999398739968 00:03:53.644 19:10:40 -- setup/devices.sh@204 -- # (( 1999398739968 >= min_disk_size )) 00:03:53.644 19:10:40 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:53.644 19:10:40 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5f:00.0 00:03:53.644 19:10:40 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:53.644 19:10:40 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:53.644 19:10:40 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:53.644 19:10:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:53.644 19:10:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:53.644 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:03:53.903 ************************************ 00:03:53.903 START TEST nvme_mount 00:03:53.903 ************************************ 00:03:53.903 19:10:40 -- common/autotest_common.sh@1111 -- # nvme_mount 00:03:53.903 19:10:40 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:53.903 19:10:40 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:53.903 19:10:40 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.903 19:10:40 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:53.903 19:10:40 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:53.903 19:10:40 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:53.903 19:10:40 -- setup/common.sh@40 -- # local part_no=1 00:03:53.903 19:10:40 -- setup/common.sh@41 -- # local size=1073741824 00:03:53.903 19:10:40 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:53.903 19:10:40 -- setup/common.sh@44 -- # parts=() 00:03:53.903 19:10:40 -- setup/common.sh@44 -- # local parts 00:03:53.903 19:10:40 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:53.903 19:10:40 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:53.903 19:10:40 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:53.903 19:10:40 -- setup/common.sh@46 -- # (( part++ )) 00:03:53.903 19:10:40 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:53.903 19:10:40 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:53.903 19:10:40 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:53.903 19:10:40 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:54.840 Creating new GPT entries in memory. 00:03:54.840 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:54.840 other utilities. 00:03:54.840 19:10:41 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:54.840 19:10:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:54.840 19:10:41 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:54.840 19:10:41 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:54.840 19:10:41 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:55.776 Creating new GPT entries in memory. 00:03:55.777 The operation has completed successfully. 00:03:55.777 19:10:42 -- setup/common.sh@57 -- # (( part++ )) 00:03:55.777 19:10:42 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:55.777 19:10:42 -- setup/common.sh@62 -- # wait 2865391 00:03:55.777 19:10:42 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:55.777 19:10:42 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:55.777 19:10:42 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:55.777 19:10:42 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:55.777 19:10:42 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:55.777 19:10:42 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:56.034 19:10:42 -- setup/devices.sh@105 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:56.035 19:10:42 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:56.035 19:10:42 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:56.035 19:10:42 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:56.035 19:10:42 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:56.035 19:10:42 -- setup/devices.sh@53 -- # local found=0 00:03:56.035 19:10:42 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:56.035 19:10:42 -- setup/devices.sh@56 -- # : 00:03:56.035 19:10:42 -- setup/devices.sh@59 -- # local pci status 00:03:56.035 19:10:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.035 19:10:42 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:56.035 19:10:42 -- setup/devices.sh@47 -- # setup output config 00:03:56.035 19:10:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:56.035 19:10:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:59.332 19:10:45 -- setup/devices.sh@63 -- # found=1 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.332 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.332 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.333 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.333 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.333 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.333 19:10:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.333 19:10:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.333 19:10:45 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:59.333 19:10:45 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:59.333 19:10:45 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:45 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:59.333 19:10:45 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:59.333 19:10:45 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:59.333 19:10:45 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:45 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:45 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:59.333 19:10:45 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:59.333 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:59.333 19:10:45 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:59.333 19:10:45 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:59.333 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:59.333 /dev/nvme0n1: 8 bytes were erased at offset 0x1d185739e00 (gpt): 45 46 49 20 50 41 52 54 00:03:59.333 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:59.333 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:59.333 19:10:46 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:59.333 19:10:46 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:59.333 19:10:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:46 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:59.333 19:10:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:59.333 19:10:46 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:46 -- setup/devices.sh@116 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:59.333 19:10:46 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:59.333 19:10:46 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:59.333 19:10:46 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.333 19:10:46 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:59.333 19:10:46 -- setup/devices.sh@53 -- # local found=0 00:03:59.333 19:10:46 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:59.333 19:10:46 -- setup/devices.sh@56 -- # : 00:03:59.333 19:10:46 -- setup/devices.sh@59 -- # local pci status 00:03:59.333 19:10:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.333 19:10:46 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:59.333 19:10:46 -- setup/devices.sh@47 -- # setup output config 00:03:59.333 19:10:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.333 19:10:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:02.617 19:10:48 -- setup/devices.sh@63 -- # found=1 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.617 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.617 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.618 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.618 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.618 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.618 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:02.618 19:10:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:49 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:02.618 19:10:49 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:02.618 19:10:49 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:02.618 19:10:49 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:02.618 19:10:49 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:02.618 19:10:49 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:02.618 19:10:49 -- setup/devices.sh@125 -- # verify 0000:5f:00.0 data@nvme0n1 '' '' 00:04:02.618 19:10:49 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:02.618 19:10:49 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:02.618 19:10:49 -- setup/devices.sh@50 -- # local mount_point= 00:04:02.618 19:10:49 -- setup/devices.sh@51 -- # local test_file= 00:04:02.618 19:10:49 -- setup/devices.sh@53 -- # local found=0 00:04:02.618 19:10:49 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:02.618 19:10:49 -- setup/devices.sh@59 -- # local pci status 00:04:02.618 19:10:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:02.618 19:10:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:02.618 19:10:49 -- setup/devices.sh@47 -- # setup output config 00:04:02.618 19:10:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:02.618 19:10:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:05.149 19:10:51 -- setup/devices.sh@63 -- # found=1 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.149 19:10:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.149 19:10:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:05.149 19:10:52 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:05.149 19:10:52 -- setup/devices.sh@68 -- # return 0 00:04:05.149 19:10:52 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:05.149 19:10:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:05.149 19:10:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:05.149 19:10:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:05.149 19:10:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:05.149 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:05.149 00:04:05.149 real 0m11.427s 00:04:05.149 user 0m3.215s 00:04:05.149 sys 0m5.952s 00:04:05.149 19:10:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:05.149 19:10:52 -- common/autotest_common.sh@10 -- # set +x 00:04:05.149 ************************************ 00:04:05.149 END TEST nvme_mount 00:04:05.149 ************************************ 00:04:05.149 19:10:52 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:05.149 19:10:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.149 19:10:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.149 19:10:52 -- common/autotest_common.sh@10 -- # set +x 00:04:05.407 ************************************ 00:04:05.407 START TEST dm_mount 00:04:05.407 ************************************ 00:04:05.407 19:10:52 -- common/autotest_common.sh@1111 -- # dm_mount 00:04:05.407 19:10:52 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:05.407 19:10:52 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:05.407 19:10:52 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:05.407 19:10:52 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:05.407 19:10:52 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:05.407 19:10:52 -- setup/common.sh@40 -- # local part_no=2 00:04:05.407 19:10:52 -- setup/common.sh@41 -- # local size=1073741824 00:04:05.407 19:10:52 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:05.407 19:10:52 -- setup/common.sh@44 -- # parts=() 00:04:05.407 19:10:52 -- setup/common.sh@44 -- # local parts 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:05.407 19:10:52 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part++ )) 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:05.407 19:10:52 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part++ )) 00:04:05.407 19:10:52 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:05.407 19:10:52 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:05.407 19:10:52 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:05.407 19:10:52 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:06.341 Creating new GPT entries in memory. 00:04:06.341 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:06.341 other utilities. 00:04:06.341 19:10:53 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:06.341 19:10:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:06.341 19:10:53 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:06.341 19:10:53 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:06.341 19:10:53 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:07.721 Creating new GPT entries in memory. 00:04:07.721 The operation has completed successfully. 00:04:07.721 19:10:54 -- setup/common.sh@57 -- # (( part++ )) 00:04:07.721 19:10:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:07.721 19:10:54 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:07.721 19:10:54 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:07.721 19:10:54 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:08.659 The operation has completed successfully. 00:04:08.659 19:10:55 -- setup/common.sh@57 -- # (( part++ )) 00:04:08.659 19:10:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:08.659 19:10:55 -- setup/common.sh@62 -- # wait 2869204 00:04:08.659 19:10:55 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:08.659 19:10:55 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:08.659 19:10:55 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:08.659 19:10:55 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:08.659 19:10:55 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:08.659 19:10:55 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:08.659 19:10:55 -- setup/devices.sh@161 -- # break 00:04:08.659 19:10:55 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:08.659 19:10:55 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:08.659 19:10:55 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:08.659 19:10:55 -- setup/devices.sh@166 -- # dm=dm-0 00:04:08.659 19:10:55 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:08.659 19:10:55 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:08.659 19:10:55 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:08.659 19:10:55 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:04:08.659 19:10:55 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:08.659 19:10:55 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:08.659 19:10:55 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:08.659 19:10:55 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:08.660 19:10:55 -- setup/devices.sh@174 -- # verify 0000:5f:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:08.660 19:10:55 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:08.660 19:10:55 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:08.660 19:10:55 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:08.660 19:10:55 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:08.660 19:10:55 -- setup/devices.sh@53 -- # local found=0 00:04:08.660 19:10:55 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:08.660 19:10:55 -- setup/devices.sh@56 -- # : 00:04:08.660 19:10:55 -- setup/devices.sh@59 -- # local pci status 00:04:08.660 19:10:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:08.660 19:10:55 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:08.660 19:10:55 -- setup/devices.sh@47 -- # setup output config 00:04:08.660 19:10:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:08.660 19:10:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:11.944 19:10:58 -- setup/devices.sh@63 -- # found=1 00:04:11.944 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.944 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.944 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.944 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.944 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.944 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:11.945 19:10:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:11.945 19:10:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:11.945 19:10:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:11.945 19:10:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:11.945 19:10:58 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:11.945 19:10:58 -- setup/devices.sh@184 -- # verify 0000:5f:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:11.945 19:10:58 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:11.945 19:10:58 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:11.945 19:10:58 -- setup/devices.sh@50 -- # local mount_point= 00:04:11.945 19:10:58 -- setup/devices.sh@51 -- # local test_file= 00:04:11.945 19:10:58 -- setup/devices.sh@53 -- # local found=0 00:04:11.945 19:10:58 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:11.945 19:10:58 -- setup/devices.sh@59 -- # local pci status 00:04:11.945 19:10:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.945 19:10:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:11.945 19:10:58 -- setup/devices.sh@47 -- # setup output config 00:04:11.945 19:10:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:11.945 19:10:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:14.548 19:11:01 -- setup/devices.sh@63 -- # found=1 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.548 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.548 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.549 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.549 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.549 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.549 19:11:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.549 19:11:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:14.549 19:11:01 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:14.549 19:11:01 -- setup/devices.sh@68 -- # return 0 00:04:14.549 19:11:01 -- setup/devices.sh@187 -- # cleanup_dm 00:04:14.549 19:11:01 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:14.549 19:11:01 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:14.549 19:11:01 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:14.549 19:11:01 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:14.549 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:14.549 19:11:01 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:14.549 00:04:14.549 real 0m9.196s 00:04:14.549 user 0m2.177s 00:04:14.549 sys 0m4.028s 00:04:14.549 19:11:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.549 19:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:14.549 ************************************ 00:04:14.549 END TEST dm_mount 00:04:14.549 ************************************ 00:04:14.549 19:11:01 -- setup/devices.sh@1 -- # cleanup 00:04:14.549 19:11:01 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:14.549 19:11:01 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:14.549 19:11:01 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:14.549 19:11:01 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:14.549 19:11:01 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:14.807 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:14.807 /dev/nvme0n1: 8 bytes were erased at offset 0x1d185739e00 (gpt): 45 46 49 20 50 41 52 54 00:04:14.807 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:14.807 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:14.807 19:11:01 -- setup/devices.sh@12 -- # cleanup_dm 00:04:14.807 19:11:01 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:14.807 19:11:01 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:14.807 19:11:01 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:14.807 19:11:01 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:14.807 19:11:01 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:14.807 19:11:01 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:14.807 00:04:14.807 real 0m24.638s 00:04:14.807 user 0m6.649s 00:04:14.807 sys 0m12.555s 00:04:14.807 19:11:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.807 19:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:14.807 ************************************ 00:04:14.807 END TEST devices 00:04:14.807 ************************************ 00:04:15.066 00:04:15.066 real 1m29.976s 00:04:15.066 user 0m27.464s 00:04:15.066 sys 0m49.895s 00:04:15.066 19:11:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:15.066 19:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:15.066 ************************************ 00:04:15.066 END TEST setup.sh 00:04:15.066 ************************************ 00:04:15.066 19:11:01 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:04:17.602 Hugepages 00:04:17.602 node hugesize free / total 00:04:17.602 node0 1048576kB 0 / 0 00:04:17.602 node0 2048kB 2048 / 2048 00:04:17.602 node1 1048576kB 0 / 0 00:04:17.602 node1 2048kB 0 / 0 00:04:17.602 00:04:17.602 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:17.602 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:04:17.602 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:04:17.602 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:04:17.602 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:04:17.861 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:04:17.861 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:04:17.861 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:04:17.861 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:04:17.861 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:04:17.861 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:04:17.861 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:04:17.861 19:11:04 -- spdk/autotest.sh@130 -- # uname -s 00:04:17.861 19:11:04 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:04:17.861 19:11:04 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:04:17.861 19:11:04 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:21.154 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:21.154 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:23.060 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:23.060 19:11:09 -- common/autotest_common.sh@1518 -- # sleep 1 00:04:23.997 19:11:10 -- common/autotest_common.sh@1519 -- # bdfs=() 00:04:23.997 19:11:10 -- common/autotest_common.sh@1519 -- # local bdfs 00:04:23.997 19:11:10 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:04:23.997 19:11:10 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:04:23.997 19:11:10 -- common/autotest_common.sh@1499 -- # bdfs=() 00:04:23.997 19:11:10 -- common/autotest_common.sh@1499 -- # local bdfs 00:04:23.997 19:11:10 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:23.997 19:11:10 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:23.997 19:11:10 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:04:24.256 19:11:11 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:04:24.256 19:11:11 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:04:24.256 19:11:11 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.788 Waiting for block devices as requested 00:04:26.788 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:04:26.788 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:27.048 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:27.048 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:27.048 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:27.048 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:27.307 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:27.307 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:27.307 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:27.566 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:27.566 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:27.566 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:27.566 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:27.825 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:27.825 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:27.825 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:28.085 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:28.085 19:11:14 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:04:28.085 19:11:14 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:5f:00.0 00:04:28.085 19:11:14 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:04:28.085 19:11:14 -- common/autotest_common.sh@1488 -- # grep 0000:5f:00.0/nvme/nvme 00:04:28.085 19:11:15 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 ]] 00:04:28.085 19:11:15 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:04:28.085 19:11:15 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1531 -- # grep oacs 00:04:28.085 19:11:15 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:04:28.085 19:11:15 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:04:28.085 19:11:15 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:04:28.085 19:11:15 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:04:28.085 19:11:15 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:28.085 19:11:15 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:04:28.085 19:11:15 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:28.085 19:11:15 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:04:28.085 19:11:15 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:04:28.085 19:11:15 -- common/autotest_common.sh@1543 -- # continue 00:04:28.085 19:11:15 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:04:28.085 19:11:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:28.085 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:28.085 19:11:15 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:04:28.085 19:11:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:28.085 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:28.085 19:11:15 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:31.369 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:31.369 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:33.270 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:33.270 19:11:20 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:04:33.270 19:11:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:33.270 19:11:20 -- common/autotest_common.sh@10 -- # set +x 00:04:33.270 19:11:20 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:04:33.270 19:11:20 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:04:33.270 19:11:20 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:04:33.270 19:11:20 -- common/autotest_common.sh@1563 -- # bdfs=() 00:04:33.270 19:11:20 -- common/autotest_common.sh@1563 -- # local bdfs 00:04:33.270 19:11:20 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:04:33.270 19:11:20 -- common/autotest_common.sh@1499 -- # bdfs=() 00:04:33.270 19:11:20 -- common/autotest_common.sh@1499 -- # local bdfs 00:04:33.270 19:11:20 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:33.270 19:11:20 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:33.270 19:11:20 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:04:33.270 19:11:20 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:04:33.270 19:11:20 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:04:33.270 19:11:20 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:04:33.270 19:11:20 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:5f:00.0/device 00:04:33.270 19:11:20 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:04:33.270 19:11:20 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:33.270 19:11:20 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:04:33.270 19:11:20 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:5f:00.0 00:04:33.270 19:11:20 -- common/autotest_common.sh@1578 -- # [[ -z 0000:5f:00.0 ]] 00:04:33.270 19:11:20 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=2877116 00:04:33.270 19:11:20 -- common/autotest_common.sh@1584 -- # waitforlisten 2877116 00:04:33.270 19:11:20 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:33.270 19:11:20 -- common/autotest_common.sh@817 -- # '[' -z 2877116 ']' 00:04:33.270 19:11:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.270 19:11:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:33.270 19:11:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.270 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.270 19:11:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:33.270 19:11:20 -- common/autotest_common.sh@10 -- # set +x 00:04:33.270 [2024-04-24 19:11:20.264526] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:04:33.270 [2024-04-24 19:11:20.264585] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2877116 ] 00:04:33.528 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.528 [2024-04-24 19:11:20.336998] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.528 [2024-04-24 19:11:20.426937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.093 19:11:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:34.093 19:11:21 -- common/autotest_common.sh@850 -- # return 0 00:04:34.093 19:11:21 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:04:34.093 19:11:21 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:04:34.093 19:11:21 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5f:00.0 00:04:37.368 nvme0n1 00:04:37.368 19:11:24 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:37.368 [2024-04-24 19:11:24.230135] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:04:37.368 request: 00:04:37.368 { 00:04:37.368 "nvme_ctrlr_name": "nvme0", 00:04:37.368 "password": "test", 00:04:37.368 "method": "bdev_nvme_opal_revert", 00:04:37.368 "req_id": 1 00:04:37.368 } 00:04:37.368 Got JSON-RPC error response 00:04:37.368 response: 00:04:37.368 { 00:04:37.368 "code": -32602, 00:04:37.368 "message": "Invalid parameters" 00:04:37.368 } 00:04:37.368 19:11:24 -- common/autotest_common.sh@1590 -- # true 00:04:37.368 19:11:24 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:04:37.368 19:11:24 -- common/autotest_common.sh@1594 -- # killprocess 2877116 00:04:37.368 19:11:24 -- common/autotest_common.sh@936 -- # '[' -z 2877116 ']' 00:04:37.368 19:11:24 -- common/autotest_common.sh@940 -- # kill -0 2877116 00:04:37.368 19:11:24 -- common/autotest_common.sh@941 -- # uname 00:04:37.368 19:11:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.368 19:11:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2877116 00:04:37.368 19:11:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.368 19:11:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.368 19:11:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2877116' 00:04:37.368 killing process with pid 2877116 00:04:37.368 19:11:24 -- common/autotest_common.sh@955 -- # kill 2877116 00:04:37.368 19:11:24 -- common/autotest_common.sh@960 -- # wait 2877116 00:04:40.651 19:11:26 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:40.651 19:11:27 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:40.651 19:11:27 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:40.651 19:11:27 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:40.651 19:11:27 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:40.651 19:11:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:40.651 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:04:40.651 19:11:27 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:40.651 19:11:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.651 19:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.651 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:04:40.651 ************************************ 00:04:40.651 START TEST env 00:04:40.651 ************************************ 00:04:40.651 19:11:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:40.651 * Looking for test storage... 00:04:40.651 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:04:40.651 19:11:27 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:40.651 19:11:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.651 19:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.651 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:04:40.651 ************************************ 00:04:40.651 START TEST env_memory 00:04:40.651 ************************************ 00:04:40.651 19:11:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:40.651 00:04:40.651 00:04:40.651 CUnit - A unit testing framework for C - Version 2.1-3 00:04:40.651 http://cunit.sourceforge.net/ 00:04:40.651 00:04:40.651 00:04:40.651 Suite: memory 00:04:40.651 Test: alloc and free memory map ...[2024-04-24 19:11:27.472143] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:40.651 passed 00:04:40.651 Test: mem map translation ...[2024-04-24 19:11:27.490598] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:40.651 [2024-04-24 19:11:27.490616] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:40.651 [2024-04-24 19:11:27.490651] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:40.651 [2024-04-24 19:11:27.490660] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:40.651 passed 00:04:40.651 Test: mem map registration ...[2024-04-24 19:11:27.526605] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:40.651 [2024-04-24 19:11:27.526623] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:40.651 passed 00:04:40.651 Test: mem map adjacent registrations ...passed 00:04:40.651 00:04:40.651 Run Summary: Type Total Ran Passed Failed Inactive 00:04:40.651 suites 1 1 n/a 0 0 00:04:40.651 tests 4 4 4 0 0 00:04:40.651 asserts 152 152 152 0 n/a 00:04:40.651 00:04:40.651 Elapsed time = 0.134 seconds 00:04:40.651 00:04:40.651 real 0m0.147s 00:04:40.651 user 0m0.137s 00:04:40.651 sys 0m0.009s 00:04:40.651 19:11:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:40.651 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:04:40.651 ************************************ 00:04:40.651 END TEST env_memory 00:04:40.651 ************************************ 00:04:40.651 19:11:27 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:40.651 19:11:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.651 19:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.651 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:04:40.910 ************************************ 00:04:40.910 START TEST env_vtophys 00:04:40.910 ************************************ 00:04:40.910 19:11:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:40.910 EAL: lib.eal log level changed from notice to debug 00:04:40.910 EAL: Detected lcore 0 as core 0 on socket 0 00:04:40.910 EAL: Detected lcore 1 as core 1 on socket 0 00:04:40.910 EAL: Detected lcore 2 as core 2 on socket 0 00:04:40.910 EAL: Detected lcore 3 as core 3 on socket 0 00:04:40.910 EAL: Detected lcore 4 as core 4 on socket 0 00:04:40.910 EAL: Detected lcore 5 as core 8 on socket 0 00:04:40.910 EAL: Detected lcore 6 as core 9 on socket 0 00:04:40.910 EAL: Detected lcore 7 as core 10 on socket 0 00:04:40.910 EAL: Detected lcore 8 as core 11 on socket 0 00:04:40.910 EAL: Detected lcore 9 as core 16 on socket 0 00:04:40.910 EAL: Detected lcore 10 as core 17 on socket 0 00:04:40.911 EAL: Detected lcore 11 as core 18 on socket 0 00:04:40.911 EAL: Detected lcore 12 as core 19 on socket 0 00:04:40.911 EAL: Detected lcore 13 as core 20 on socket 0 00:04:40.911 EAL: Detected lcore 14 as core 24 on socket 0 00:04:40.911 EAL: Detected lcore 15 as core 25 on socket 0 00:04:40.911 EAL: Detected lcore 16 as core 26 on socket 0 00:04:40.911 EAL: Detected lcore 17 as core 27 on socket 0 00:04:40.911 EAL: Detected lcore 18 as core 0 on socket 1 00:04:40.911 EAL: Detected lcore 19 as core 1 on socket 1 00:04:40.911 EAL: Detected lcore 20 as core 2 on socket 1 00:04:40.911 EAL: Detected lcore 21 as core 3 on socket 1 00:04:40.911 EAL: Detected lcore 22 as core 4 on socket 1 00:04:40.911 EAL: Detected lcore 23 as core 8 on socket 1 00:04:40.911 EAL: Detected lcore 24 as core 9 on socket 1 00:04:40.911 EAL: Detected lcore 25 as core 10 on socket 1 00:04:40.911 EAL: Detected lcore 26 as core 11 on socket 1 00:04:40.911 EAL: Detected lcore 27 as core 16 on socket 1 00:04:40.911 EAL: Detected lcore 28 as core 17 on socket 1 00:04:40.911 EAL: Detected lcore 29 as core 18 on socket 1 00:04:40.911 EAL: Detected lcore 30 as core 19 on socket 1 00:04:40.911 EAL: Detected lcore 31 as core 20 on socket 1 00:04:40.911 EAL: Detected lcore 32 as core 24 on socket 1 00:04:40.911 EAL: Detected lcore 33 as core 25 on socket 1 00:04:40.911 EAL: Detected lcore 34 as core 26 on socket 1 00:04:40.911 EAL: Detected lcore 35 as core 27 on socket 1 00:04:40.911 EAL: Detected lcore 36 as core 0 on socket 0 00:04:40.911 EAL: Detected lcore 37 as core 1 on socket 0 00:04:40.911 EAL: Detected lcore 38 as core 2 on socket 0 00:04:40.911 EAL: Detected lcore 39 as core 3 on socket 0 00:04:40.911 EAL: Detected lcore 40 as core 4 on socket 0 00:04:40.911 EAL: Detected lcore 41 as core 8 on socket 0 00:04:40.911 EAL: Detected lcore 42 as core 9 on socket 0 00:04:40.911 EAL: Detected lcore 43 as core 10 on socket 0 00:04:40.911 EAL: Detected lcore 44 as core 11 on socket 0 00:04:40.911 EAL: Detected lcore 45 as core 16 on socket 0 00:04:40.911 EAL: Detected lcore 46 as core 17 on socket 0 00:04:40.911 EAL: Detected lcore 47 as core 18 on socket 0 00:04:40.911 EAL: Detected lcore 48 as core 19 on socket 0 00:04:40.911 EAL: Detected lcore 49 as core 20 on socket 0 00:04:40.911 EAL: Detected lcore 50 as core 24 on socket 0 00:04:40.911 EAL: Detected lcore 51 as core 25 on socket 0 00:04:40.911 EAL: Detected lcore 52 as core 26 on socket 0 00:04:40.911 EAL: Detected lcore 53 as core 27 on socket 0 00:04:40.911 EAL: Detected lcore 54 as core 0 on socket 1 00:04:40.911 EAL: Detected lcore 55 as core 1 on socket 1 00:04:40.911 EAL: Detected lcore 56 as core 2 on socket 1 00:04:40.911 EAL: Detected lcore 57 as core 3 on socket 1 00:04:40.911 EAL: Detected lcore 58 as core 4 on socket 1 00:04:40.911 EAL: Detected lcore 59 as core 8 on socket 1 00:04:40.911 EAL: Detected lcore 60 as core 9 on socket 1 00:04:40.911 EAL: Detected lcore 61 as core 10 on socket 1 00:04:40.911 EAL: Detected lcore 62 as core 11 on socket 1 00:04:40.911 EAL: Detected lcore 63 as core 16 on socket 1 00:04:40.911 EAL: Detected lcore 64 as core 17 on socket 1 00:04:40.911 EAL: Detected lcore 65 as core 18 on socket 1 00:04:40.911 EAL: Detected lcore 66 as core 19 on socket 1 00:04:40.911 EAL: Detected lcore 67 as core 20 on socket 1 00:04:40.911 EAL: Detected lcore 68 as core 24 on socket 1 00:04:40.911 EAL: Detected lcore 69 as core 25 on socket 1 00:04:40.911 EAL: Detected lcore 70 as core 26 on socket 1 00:04:40.911 EAL: Detected lcore 71 as core 27 on socket 1 00:04:40.911 EAL: Maximum logical cores by configuration: 128 00:04:40.911 EAL: Detected CPU lcores: 72 00:04:40.911 EAL: Detected NUMA nodes: 2 00:04:40.911 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:40.911 EAL: Detected shared linkage of DPDK 00:04:40.911 EAL: No shared files mode enabled, IPC will be disabled 00:04:40.911 EAL: Bus pci wants IOVA as 'DC' 00:04:40.911 EAL: Buses did not request a specific IOVA mode. 00:04:40.911 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:40.911 EAL: Selected IOVA mode 'VA' 00:04:40.911 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.911 EAL: Probing VFIO support... 00:04:40.911 EAL: IOMMU type 1 (Type 1) is supported 00:04:40.911 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:40.911 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:40.911 EAL: VFIO support initialized 00:04:40.911 EAL: Ask a virtual area of 0x2e000 bytes 00:04:40.911 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:40.911 EAL: Setting up physically contiguous memory... 00:04:40.911 EAL: Setting maximum number of open files to 524288 00:04:40.911 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:40.911 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:40.911 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:40.911 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:40.911 EAL: Ask a virtual area of 0x61000 bytes 00:04:40.911 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:40.911 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:40.911 EAL: Ask a virtual area of 0x400000000 bytes 00:04:40.911 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:40.911 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:40.911 EAL: Hugepages will be freed exactly as allocated. 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: TSC frequency is ~2300000 KHz 00:04:40.911 EAL: Main lcore 0 is ready (tid=7f4967ae3a00;cpuset=[0]) 00:04:40.911 EAL: Trying to obtain current memory policy. 00:04:40.911 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.911 EAL: Restoring previous memory policy: 0 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was expanded by 2MB 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:40.911 EAL: Mem event callback 'spdk:(nil)' registered 00:04:40.911 00:04:40.911 00:04:40.911 CUnit - A unit testing framework for C - Version 2.1-3 00:04:40.911 http://cunit.sourceforge.net/ 00:04:40.911 00:04:40.911 00:04:40.911 Suite: components_suite 00:04:40.911 Test: vtophys_malloc_test ...passed 00:04:40.911 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:40.911 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.911 EAL: Restoring previous memory policy: 4 00:04:40.911 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was expanded by 4MB 00:04:40.911 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was shrunk by 4MB 00:04:40.911 EAL: Trying to obtain current memory policy. 00:04:40.911 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.911 EAL: Restoring previous memory policy: 4 00:04:40.911 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was expanded by 6MB 00:04:40.911 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was shrunk by 6MB 00:04:40.911 EAL: Trying to obtain current memory policy. 00:04:40.911 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.911 EAL: Restoring previous memory policy: 4 00:04:40.911 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.911 EAL: request: mp_malloc_sync 00:04:40.911 EAL: No shared files mode enabled, IPC is disabled 00:04:40.911 EAL: Heap on socket 0 was expanded by 10MB 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was shrunk by 10MB 00:04:40.912 EAL: Trying to obtain current memory policy. 00:04:40.912 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.912 EAL: Restoring previous memory policy: 4 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was expanded by 18MB 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was shrunk by 18MB 00:04:40.912 EAL: Trying to obtain current memory policy. 00:04:40.912 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.912 EAL: Restoring previous memory policy: 4 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was expanded by 34MB 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was shrunk by 34MB 00:04:40.912 EAL: Trying to obtain current memory policy. 00:04:40.912 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:40.912 EAL: Restoring previous memory policy: 4 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was expanded by 66MB 00:04:40.912 EAL: Calling mem event callback 'spdk:(nil)' 00:04:40.912 EAL: request: mp_malloc_sync 00:04:40.912 EAL: No shared files mode enabled, IPC is disabled 00:04:40.912 EAL: Heap on socket 0 was shrunk by 66MB 00:04:40.912 EAL: Trying to obtain current memory policy. 00:04:40.912 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:41.170 EAL: Restoring previous memory policy: 4 00:04:41.170 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.170 EAL: request: mp_malloc_sync 00:04:41.170 EAL: No shared files mode enabled, IPC is disabled 00:04:41.170 EAL: Heap on socket 0 was expanded by 130MB 00:04:41.170 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.170 EAL: request: mp_malloc_sync 00:04:41.170 EAL: No shared files mode enabled, IPC is disabled 00:04:41.170 EAL: Heap on socket 0 was shrunk by 130MB 00:04:41.170 EAL: Trying to obtain current memory policy. 00:04:41.170 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:41.170 EAL: Restoring previous memory policy: 4 00:04:41.170 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.170 EAL: request: mp_malloc_sync 00:04:41.170 EAL: No shared files mode enabled, IPC is disabled 00:04:41.170 EAL: Heap on socket 0 was expanded by 258MB 00:04:41.170 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.170 EAL: request: mp_malloc_sync 00:04:41.170 EAL: No shared files mode enabled, IPC is disabled 00:04:41.170 EAL: Heap on socket 0 was shrunk by 258MB 00:04:41.170 EAL: Trying to obtain current memory policy. 00:04:41.170 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:41.429 EAL: Restoring previous memory policy: 4 00:04:41.429 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.429 EAL: request: mp_malloc_sync 00:04:41.429 EAL: No shared files mode enabled, IPC is disabled 00:04:41.429 EAL: Heap on socket 0 was expanded by 514MB 00:04:41.429 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.429 EAL: request: mp_malloc_sync 00:04:41.429 EAL: No shared files mode enabled, IPC is disabled 00:04:41.429 EAL: Heap on socket 0 was shrunk by 514MB 00:04:41.429 EAL: Trying to obtain current memory policy. 00:04:41.429 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:41.687 EAL: Restoring previous memory policy: 4 00:04:41.687 EAL: Calling mem event callback 'spdk:(nil)' 00:04:41.687 EAL: request: mp_malloc_sync 00:04:41.687 EAL: No shared files mode enabled, IPC is disabled 00:04:41.687 EAL: Heap on socket 0 was expanded by 1026MB 00:04:41.945 EAL: Calling mem event callback 'spdk:(nil)' 00:04:42.204 EAL: request: mp_malloc_sync 00:04:42.204 EAL: No shared files mode enabled, IPC is disabled 00:04:42.204 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:42.204 passed 00:04:42.204 00:04:42.204 Run Summary: Type Total Ran Passed Failed Inactive 00:04:42.204 suites 1 1 n/a 0 0 00:04:42.204 tests 2 2 2 0 0 00:04:42.204 asserts 497 497 497 0 n/a 00:04:42.204 00:04:42.204 Elapsed time = 1.126 seconds 00:04:42.204 EAL: Calling mem event callback 'spdk:(nil)' 00:04:42.204 EAL: request: mp_malloc_sync 00:04:42.204 EAL: No shared files mode enabled, IPC is disabled 00:04:42.204 EAL: Heap on socket 0 was shrunk by 2MB 00:04:42.204 EAL: No shared files mode enabled, IPC is disabled 00:04:42.204 EAL: No shared files mode enabled, IPC is disabled 00:04:42.204 EAL: No shared files mode enabled, IPC is disabled 00:04:42.204 00:04:42.204 real 0m1.247s 00:04:42.204 user 0m0.717s 00:04:42.204 sys 0m0.499s 00:04:42.204 19:11:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:42.204 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:04:42.204 ************************************ 00:04:42.204 END TEST env_vtophys 00:04:42.204 ************************************ 00:04:42.204 19:11:29 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:42.204 19:11:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.204 19:11:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.204 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:04:42.204 ************************************ 00:04:42.204 START TEST env_pci 00:04:42.204 ************************************ 00:04:42.204 19:11:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:42.204 00:04:42.204 00:04:42.204 CUnit - A unit testing framework for C - Version 2.1-3 00:04:42.204 http://cunit.sourceforge.net/ 00:04:42.204 00:04:42.204 00:04:42.204 Suite: pci 00:04:42.204 Test: pci_hook ...[2024-04-24 19:11:29.173958] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2878336 has claimed it 00:04:42.204 EAL: Cannot find device (10000:00:01.0) 00:04:42.204 EAL: Failed to attach device on primary process 00:04:42.204 passed 00:04:42.204 00:04:42.204 Run Summary: Type Total Ran Passed Failed Inactive 00:04:42.204 suites 1 1 n/a 0 0 00:04:42.204 tests 1 1 1 0 0 00:04:42.204 asserts 25 25 25 0 n/a 00:04:42.204 00:04:42.204 Elapsed time = 0.027 seconds 00:04:42.204 00:04:42.204 real 0m0.041s 00:04:42.204 user 0m0.014s 00:04:42.204 sys 0m0.027s 00:04:42.204 19:11:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:42.204 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:04:42.204 ************************************ 00:04:42.204 END TEST env_pci 00:04:42.204 ************************************ 00:04:42.462 19:11:29 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:42.462 19:11:29 -- env/env.sh@15 -- # uname 00:04:42.462 19:11:29 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:42.462 19:11:29 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:42.462 19:11:29 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:42.462 19:11:29 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:42.462 19:11:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.462 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:04:42.462 ************************************ 00:04:42.462 START TEST env_dpdk_post_init 00:04:42.462 ************************************ 00:04:42.462 19:11:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:42.462 EAL: Detected CPU lcores: 72 00:04:42.462 EAL: Detected NUMA nodes: 2 00:04:42.462 EAL: Detected shared linkage of DPDK 00:04:42.462 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:42.462 EAL: Selected IOVA mode 'VA' 00:04:42.462 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.462 EAL: VFIO support initialized 00:04:42.721 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:42.721 EAL: Using IOMMU type 1 (Type 1) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:42.721 EAL: Ignore mapping IO port bar(1) 00:04:42.721 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:43.676 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5f:00.0 (socket 0) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:43.676 EAL: Ignore mapping IO port bar(1) 00:04:43.676 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:47.894 EAL: Releasing PCI mapped resource for 0000:5f:00.0 00:04:47.894 EAL: Calling pci_unmap_resource for 0000:5f:00.0 at 0x202001020000 00:04:47.894 Starting DPDK initialization... 00:04:47.894 Starting SPDK post initialization... 00:04:47.894 SPDK NVMe probe 00:04:47.894 Attaching to 0000:5f:00.0 00:04:47.894 Attached to 0000:5f:00.0 00:04:47.894 Cleaning up... 00:04:47.894 00:04:47.894 real 0m5.317s 00:04:47.894 user 0m3.929s 00:04:47.894 sys 0m0.458s 00:04:47.894 19:11:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:47.894 19:11:34 -- common/autotest_common.sh@10 -- # set +x 00:04:47.894 ************************************ 00:04:47.894 END TEST env_dpdk_post_init 00:04:47.894 ************************************ 00:04:47.894 19:11:34 -- env/env.sh@26 -- # uname 00:04:47.894 19:11:34 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:47.894 19:11:34 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:47.894 19:11:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.894 19:11:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.894 19:11:34 -- common/autotest_common.sh@10 -- # set +x 00:04:48.151 ************************************ 00:04:48.151 START TEST env_mem_callbacks 00:04:48.151 ************************************ 00:04:48.151 19:11:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:48.151 EAL: Detected CPU lcores: 72 00:04:48.151 EAL: Detected NUMA nodes: 2 00:04:48.151 EAL: Detected shared linkage of DPDK 00:04:48.151 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:48.151 EAL: Selected IOVA mode 'VA' 00:04:48.151 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.151 EAL: VFIO support initialized 00:04:48.151 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:48.151 00:04:48.151 00:04:48.151 CUnit - A unit testing framework for C - Version 2.1-3 00:04:48.151 http://cunit.sourceforge.net/ 00:04:48.151 00:04:48.151 00:04:48.151 Suite: memory 00:04:48.151 Test: test ... 00:04:48.151 register 0x200000200000 2097152 00:04:48.151 malloc 3145728 00:04:48.151 register 0x200000400000 4194304 00:04:48.151 buf 0x200000500000 len 3145728 PASSED 00:04:48.151 malloc 64 00:04:48.151 buf 0x2000004fff40 len 64 PASSED 00:04:48.151 malloc 4194304 00:04:48.151 register 0x200000800000 6291456 00:04:48.151 buf 0x200000a00000 len 4194304 PASSED 00:04:48.151 free 0x200000500000 3145728 00:04:48.151 free 0x2000004fff40 64 00:04:48.151 unregister 0x200000400000 4194304 PASSED 00:04:48.151 free 0x200000a00000 4194304 00:04:48.151 unregister 0x200000800000 6291456 PASSED 00:04:48.151 malloc 8388608 00:04:48.151 register 0x200000400000 10485760 00:04:48.151 buf 0x200000600000 len 8388608 PASSED 00:04:48.151 free 0x200000600000 8388608 00:04:48.151 unregister 0x200000400000 10485760 PASSED 00:04:48.151 passed 00:04:48.151 00:04:48.151 Run Summary: Type Total Ran Passed Failed Inactive 00:04:48.151 suites 1 1 n/a 0 0 00:04:48.151 tests 1 1 1 0 0 00:04:48.151 asserts 15 15 15 0 n/a 00:04:48.151 00:04:48.151 Elapsed time = 0.007 seconds 00:04:48.151 00:04:48.152 real 0m0.069s 00:04:48.152 user 0m0.022s 00:04:48.152 sys 0m0.047s 00:04:48.152 19:11:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:48.152 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:04:48.152 ************************************ 00:04:48.152 END TEST env_mem_callbacks 00:04:48.152 ************************************ 00:04:48.152 00:04:48.152 real 0m7.902s 00:04:48.152 user 0m5.192s 00:04:48.152 sys 0m1.672s 00:04:48.152 19:11:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:48.152 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:04:48.152 ************************************ 00:04:48.152 END TEST env 00:04:48.152 ************************************ 00:04:48.152 19:11:35 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:48.152 19:11:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.152 19:11:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.152 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:04:48.421 ************************************ 00:04:48.421 START TEST rpc 00:04:48.421 ************************************ 00:04:48.421 19:11:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:48.421 * Looking for test storage... 00:04:48.422 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:48.422 19:11:35 -- rpc/rpc.sh@65 -- # spdk_pid=2879391 00:04:48.422 19:11:35 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:48.422 19:11:35 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:48.422 19:11:35 -- rpc/rpc.sh@67 -- # waitforlisten 2879391 00:04:48.422 19:11:35 -- common/autotest_common.sh@817 -- # '[' -z 2879391 ']' 00:04:48.422 19:11:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.422 19:11:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:48.422 19:11:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.422 19:11:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:48.422 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:04:48.422 [2024-04-24 19:11:35.400415] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:04:48.422 [2024-04-24 19:11:35.400473] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2879391 ] 00:04:48.422 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.721 [2024-04-24 19:11:35.470656] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.721 [2024-04-24 19:11:35.550775] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:48.721 [2024-04-24 19:11:35.550820] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2879391' to capture a snapshot of events at runtime. 00:04:48.722 [2024-04-24 19:11:35.550830] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:48.722 [2024-04-24 19:11:35.550855] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:48.722 [2024-04-24 19:11:35.550862] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2879391 for offline analysis/debug. 00:04:48.722 [2024-04-24 19:11:35.550889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.300 19:11:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:49.300 19:11:36 -- common/autotest_common.sh@850 -- # return 0 00:04:49.300 19:11:36 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:49.300 19:11:36 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:49.300 19:11:36 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:49.300 19:11:36 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:49.300 19:11:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.300 19:11:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.301 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.556 ************************************ 00:04:49.556 START TEST rpc_integrity 00:04:49.556 ************************************ 00:04:49.556 19:11:36 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:49.556 19:11:36 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:49.556 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.556 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.556 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:49.557 19:11:36 -- rpc/rpc.sh@13 -- # jq length 00:04:49.557 19:11:36 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:49.557 19:11:36 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:49.557 19:11:36 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:49.557 { 00:04:49.557 "name": "Malloc0", 00:04:49.557 "aliases": [ 00:04:49.557 "05cf1216-e284-47dd-871f-8af70a6d0da8" 00:04:49.557 ], 00:04:49.557 "product_name": "Malloc disk", 00:04:49.557 "block_size": 512, 00:04:49.557 "num_blocks": 16384, 00:04:49.557 "uuid": "05cf1216-e284-47dd-871f-8af70a6d0da8", 00:04:49.557 "assigned_rate_limits": { 00:04:49.557 "rw_ios_per_sec": 0, 00:04:49.557 "rw_mbytes_per_sec": 0, 00:04:49.557 "r_mbytes_per_sec": 0, 00:04:49.557 "w_mbytes_per_sec": 0 00:04:49.557 }, 00:04:49.557 "claimed": false, 00:04:49.557 "zoned": false, 00:04:49.557 "supported_io_types": { 00:04:49.557 "read": true, 00:04:49.557 "write": true, 00:04:49.557 "unmap": true, 00:04:49.557 "write_zeroes": true, 00:04:49.557 "flush": true, 00:04:49.557 "reset": true, 00:04:49.557 "compare": false, 00:04:49.557 "compare_and_write": false, 00:04:49.557 "abort": true, 00:04:49.557 "nvme_admin": false, 00:04:49.557 "nvme_io": false 00:04:49.557 }, 00:04:49.557 "memory_domains": [ 00:04:49.557 { 00:04:49.557 "dma_device_id": "system", 00:04:49.557 "dma_device_type": 1 00:04:49.557 }, 00:04:49.557 { 00:04:49.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:49.557 "dma_device_type": 2 00:04:49.557 } 00:04:49.557 ], 00:04:49.557 "driver_specific": {} 00:04:49.557 } 00:04:49.557 ]' 00:04:49.557 19:11:36 -- rpc/rpc.sh@17 -- # jq length 00:04:49.557 19:11:36 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:49.557 19:11:36 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 [2024-04-24 19:11:36.474473] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:49.557 [2024-04-24 19:11:36.474506] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:49.557 [2024-04-24 19:11:36.474520] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x21042c0 00:04:49.557 [2024-04-24 19:11:36.474528] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:49.557 [2024-04-24 19:11:36.475679] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:49.557 [2024-04-24 19:11:36.475702] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:49.557 Passthru0 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:49.557 { 00:04:49.557 "name": "Malloc0", 00:04:49.557 "aliases": [ 00:04:49.557 "05cf1216-e284-47dd-871f-8af70a6d0da8" 00:04:49.557 ], 00:04:49.557 "product_name": "Malloc disk", 00:04:49.557 "block_size": 512, 00:04:49.557 "num_blocks": 16384, 00:04:49.557 "uuid": "05cf1216-e284-47dd-871f-8af70a6d0da8", 00:04:49.557 "assigned_rate_limits": { 00:04:49.557 "rw_ios_per_sec": 0, 00:04:49.557 "rw_mbytes_per_sec": 0, 00:04:49.557 "r_mbytes_per_sec": 0, 00:04:49.557 "w_mbytes_per_sec": 0 00:04:49.557 }, 00:04:49.557 "claimed": true, 00:04:49.557 "claim_type": "exclusive_write", 00:04:49.557 "zoned": false, 00:04:49.557 "supported_io_types": { 00:04:49.557 "read": true, 00:04:49.557 "write": true, 00:04:49.557 "unmap": true, 00:04:49.557 "write_zeroes": true, 00:04:49.557 "flush": true, 00:04:49.557 "reset": true, 00:04:49.557 "compare": false, 00:04:49.557 "compare_and_write": false, 00:04:49.557 "abort": true, 00:04:49.557 "nvme_admin": false, 00:04:49.557 "nvme_io": false 00:04:49.557 }, 00:04:49.557 "memory_domains": [ 00:04:49.557 { 00:04:49.557 "dma_device_id": "system", 00:04:49.557 "dma_device_type": 1 00:04:49.557 }, 00:04:49.557 { 00:04:49.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:49.557 "dma_device_type": 2 00:04:49.557 } 00:04:49.557 ], 00:04:49.557 "driver_specific": {} 00:04:49.557 }, 00:04:49.557 { 00:04:49.557 "name": "Passthru0", 00:04:49.557 "aliases": [ 00:04:49.557 "9f662749-8aae-59e9-a68e-ec1272a4271d" 00:04:49.557 ], 00:04:49.557 "product_name": "passthru", 00:04:49.557 "block_size": 512, 00:04:49.557 "num_blocks": 16384, 00:04:49.557 "uuid": "9f662749-8aae-59e9-a68e-ec1272a4271d", 00:04:49.557 "assigned_rate_limits": { 00:04:49.557 "rw_ios_per_sec": 0, 00:04:49.557 "rw_mbytes_per_sec": 0, 00:04:49.557 "r_mbytes_per_sec": 0, 00:04:49.557 "w_mbytes_per_sec": 0 00:04:49.557 }, 00:04:49.557 "claimed": false, 00:04:49.557 "zoned": false, 00:04:49.557 "supported_io_types": { 00:04:49.557 "read": true, 00:04:49.557 "write": true, 00:04:49.557 "unmap": true, 00:04:49.557 "write_zeroes": true, 00:04:49.557 "flush": true, 00:04:49.557 "reset": true, 00:04:49.557 "compare": false, 00:04:49.557 "compare_and_write": false, 00:04:49.557 "abort": true, 00:04:49.557 "nvme_admin": false, 00:04:49.557 "nvme_io": false 00:04:49.557 }, 00:04:49.557 "memory_domains": [ 00:04:49.557 { 00:04:49.557 "dma_device_id": "system", 00:04:49.557 "dma_device_type": 1 00:04:49.557 }, 00:04:49.557 { 00:04:49.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:49.557 "dma_device_type": 2 00:04:49.557 } 00:04:49.557 ], 00:04:49.557 "driver_specific": { 00:04:49.557 "passthru": { 00:04:49.557 "name": "Passthru0", 00:04:49.557 "base_bdev_name": "Malloc0" 00:04:49.557 } 00:04:49.557 } 00:04:49.557 } 00:04:49.557 ]' 00:04:49.557 19:11:36 -- rpc/rpc.sh@21 -- # jq length 00:04:49.557 19:11:36 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:49.557 19:11:36 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.557 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.557 19:11:36 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:49.557 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.557 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.813 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:49.813 19:11:36 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:49.813 19:11:36 -- rpc/rpc.sh@26 -- # jq length 00:04:49.813 19:11:36 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:49.813 00:04:49.813 real 0m0.269s 00:04:49.813 user 0m0.161s 00:04:49.813 sys 0m0.043s 00:04:49.813 19:11:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:49.813 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.813 ************************************ 00:04:49.813 END TEST rpc_integrity 00:04:49.813 ************************************ 00:04:49.813 19:11:36 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:49.813 19:11:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.813 19:11:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.813 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:49.813 ************************************ 00:04:49.813 START TEST rpc_plugins 00:04:49.813 ************************************ 00:04:49.813 19:11:36 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:04:49.813 19:11:36 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:49.813 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:49.813 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.070 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.070 19:11:36 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:50.070 19:11:36 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:50.070 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.070 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.070 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.070 19:11:36 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:50.070 { 00:04:50.070 "name": "Malloc1", 00:04:50.070 "aliases": [ 00:04:50.070 "071eab8c-f90f-4616-a91e-1c6f34172b49" 00:04:50.070 ], 00:04:50.070 "product_name": "Malloc disk", 00:04:50.070 "block_size": 4096, 00:04:50.070 "num_blocks": 256, 00:04:50.070 "uuid": "071eab8c-f90f-4616-a91e-1c6f34172b49", 00:04:50.070 "assigned_rate_limits": { 00:04:50.070 "rw_ios_per_sec": 0, 00:04:50.070 "rw_mbytes_per_sec": 0, 00:04:50.070 "r_mbytes_per_sec": 0, 00:04:50.070 "w_mbytes_per_sec": 0 00:04:50.070 }, 00:04:50.070 "claimed": false, 00:04:50.070 "zoned": false, 00:04:50.070 "supported_io_types": { 00:04:50.070 "read": true, 00:04:50.070 "write": true, 00:04:50.070 "unmap": true, 00:04:50.070 "write_zeroes": true, 00:04:50.070 "flush": true, 00:04:50.070 "reset": true, 00:04:50.070 "compare": false, 00:04:50.070 "compare_and_write": false, 00:04:50.070 "abort": true, 00:04:50.070 "nvme_admin": false, 00:04:50.070 "nvme_io": false 00:04:50.070 }, 00:04:50.070 "memory_domains": [ 00:04:50.070 { 00:04:50.070 "dma_device_id": "system", 00:04:50.070 "dma_device_type": 1 00:04:50.070 }, 00:04:50.070 { 00:04:50.070 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:50.070 "dma_device_type": 2 00:04:50.070 } 00:04:50.070 ], 00:04:50.070 "driver_specific": {} 00:04:50.070 } 00:04:50.070 ]' 00:04:50.070 19:11:36 -- rpc/rpc.sh@32 -- # jq length 00:04:50.070 19:11:36 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:50.070 19:11:36 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:50.070 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.070 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.070 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.070 19:11:36 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:50.070 19:11:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.070 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.070 19:11:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.070 19:11:36 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:50.070 19:11:36 -- rpc/rpc.sh@36 -- # jq length 00:04:50.070 19:11:36 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:50.070 00:04:50.070 real 0m0.143s 00:04:50.070 user 0m0.085s 00:04:50.070 sys 0m0.026s 00:04:50.070 19:11:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:50.070 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.070 ************************************ 00:04:50.070 END TEST rpc_plugins 00:04:50.070 ************************************ 00:04:50.070 19:11:37 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:50.070 19:11:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.070 19:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.070 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.327 ************************************ 00:04:50.327 START TEST rpc_trace_cmd_test 00:04:50.327 ************************************ 00:04:50.327 19:11:37 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:04:50.327 19:11:37 -- rpc/rpc.sh@40 -- # local info 00:04:50.327 19:11:37 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:50.327 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.327 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.327 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.327 19:11:37 -- rpc/rpc.sh@42 -- # info='{ 00:04:50.327 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2879391", 00:04:50.327 "tpoint_group_mask": "0x8", 00:04:50.327 "iscsi_conn": { 00:04:50.327 "mask": "0x2", 00:04:50.327 "tpoint_mask": "0x0" 00:04:50.327 }, 00:04:50.327 "scsi": { 00:04:50.327 "mask": "0x4", 00:04:50.327 "tpoint_mask": "0x0" 00:04:50.327 }, 00:04:50.327 "bdev": { 00:04:50.327 "mask": "0x8", 00:04:50.327 "tpoint_mask": "0xffffffffffffffff" 00:04:50.327 }, 00:04:50.327 "nvmf_rdma": { 00:04:50.327 "mask": "0x10", 00:04:50.327 "tpoint_mask": "0x0" 00:04:50.327 }, 00:04:50.328 "nvmf_tcp": { 00:04:50.328 "mask": "0x20", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "ftl": { 00:04:50.328 "mask": "0x40", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "blobfs": { 00:04:50.328 "mask": "0x80", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "dsa": { 00:04:50.328 "mask": "0x200", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "thread": { 00:04:50.328 "mask": "0x400", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "nvme_pcie": { 00:04:50.328 "mask": "0x800", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "iaa": { 00:04:50.328 "mask": "0x1000", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "nvme_tcp": { 00:04:50.328 "mask": "0x2000", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "bdev_nvme": { 00:04:50.328 "mask": "0x4000", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 }, 00:04:50.328 "sock": { 00:04:50.328 "mask": "0x8000", 00:04:50.328 "tpoint_mask": "0x0" 00:04:50.328 } 00:04:50.328 }' 00:04:50.328 19:11:37 -- rpc/rpc.sh@43 -- # jq length 00:04:50.328 19:11:37 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:50.328 19:11:37 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:50.328 19:11:37 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:50.328 19:11:37 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:50.328 19:11:37 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:50.328 19:11:37 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:50.328 19:11:37 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:50.328 19:11:37 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:50.586 19:11:37 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:50.586 00:04:50.586 real 0m0.189s 00:04:50.586 user 0m0.150s 00:04:50.586 sys 0m0.030s 00:04:50.586 19:11:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:50.586 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.586 ************************************ 00:04:50.586 END TEST rpc_trace_cmd_test 00:04:50.586 ************************************ 00:04:50.586 19:11:37 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:50.586 19:11:37 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:50.586 19:11:37 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:50.586 19:11:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.586 19:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.586 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.586 ************************************ 00:04:50.586 START TEST rpc_daemon_integrity 00:04:50.586 ************************************ 00:04:50.586 19:11:37 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:50.586 19:11:37 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:50.586 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.586 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.586 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.586 19:11:37 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:50.586 19:11:37 -- rpc/rpc.sh@13 -- # jq length 00:04:50.844 19:11:37 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:50.844 19:11:37 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:50.844 19:11:37 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:50.844 { 00:04:50.844 "name": "Malloc2", 00:04:50.844 "aliases": [ 00:04:50.844 "c88936ea-3f88-4e44-9629-657fb3d99564" 00:04:50.844 ], 00:04:50.844 "product_name": "Malloc disk", 00:04:50.844 "block_size": 512, 00:04:50.844 "num_blocks": 16384, 00:04:50.844 "uuid": "c88936ea-3f88-4e44-9629-657fb3d99564", 00:04:50.844 "assigned_rate_limits": { 00:04:50.844 "rw_ios_per_sec": 0, 00:04:50.844 "rw_mbytes_per_sec": 0, 00:04:50.844 "r_mbytes_per_sec": 0, 00:04:50.844 "w_mbytes_per_sec": 0 00:04:50.844 }, 00:04:50.844 "claimed": false, 00:04:50.844 "zoned": false, 00:04:50.844 "supported_io_types": { 00:04:50.844 "read": true, 00:04:50.844 "write": true, 00:04:50.844 "unmap": true, 00:04:50.844 "write_zeroes": true, 00:04:50.844 "flush": true, 00:04:50.844 "reset": true, 00:04:50.844 "compare": false, 00:04:50.844 "compare_and_write": false, 00:04:50.844 "abort": true, 00:04:50.844 "nvme_admin": false, 00:04:50.844 "nvme_io": false 00:04:50.844 }, 00:04:50.844 "memory_domains": [ 00:04:50.844 { 00:04:50.844 "dma_device_id": "system", 00:04:50.844 "dma_device_type": 1 00:04:50.844 }, 00:04:50.844 { 00:04:50.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:50.844 "dma_device_type": 2 00:04:50.844 } 00:04:50.844 ], 00:04:50.844 "driver_specific": {} 00:04:50.844 } 00:04:50.844 ]' 00:04:50.844 19:11:37 -- rpc/rpc.sh@17 -- # jq length 00:04:50.844 19:11:37 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:50.844 19:11:37 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 [2024-04-24 19:11:37.681743] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:50.844 [2024-04-24 19:11:37.681776] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:50.844 [2024-04-24 19:11:37.681793] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x21055a0 00:04:50.844 [2024-04-24 19:11:37.681802] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:50.844 [2024-04-24 19:11:37.682764] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:50.844 [2024-04-24 19:11:37.682786] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:50.844 Passthru0 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:50.844 { 00:04:50.844 "name": "Malloc2", 00:04:50.844 "aliases": [ 00:04:50.844 "c88936ea-3f88-4e44-9629-657fb3d99564" 00:04:50.844 ], 00:04:50.844 "product_name": "Malloc disk", 00:04:50.844 "block_size": 512, 00:04:50.844 "num_blocks": 16384, 00:04:50.844 "uuid": "c88936ea-3f88-4e44-9629-657fb3d99564", 00:04:50.844 "assigned_rate_limits": { 00:04:50.844 "rw_ios_per_sec": 0, 00:04:50.844 "rw_mbytes_per_sec": 0, 00:04:50.844 "r_mbytes_per_sec": 0, 00:04:50.844 "w_mbytes_per_sec": 0 00:04:50.844 }, 00:04:50.844 "claimed": true, 00:04:50.844 "claim_type": "exclusive_write", 00:04:50.844 "zoned": false, 00:04:50.844 "supported_io_types": { 00:04:50.844 "read": true, 00:04:50.844 "write": true, 00:04:50.844 "unmap": true, 00:04:50.844 "write_zeroes": true, 00:04:50.844 "flush": true, 00:04:50.844 "reset": true, 00:04:50.844 "compare": false, 00:04:50.844 "compare_and_write": false, 00:04:50.844 "abort": true, 00:04:50.844 "nvme_admin": false, 00:04:50.844 "nvme_io": false 00:04:50.844 }, 00:04:50.844 "memory_domains": [ 00:04:50.844 { 00:04:50.844 "dma_device_id": "system", 00:04:50.844 "dma_device_type": 1 00:04:50.844 }, 00:04:50.844 { 00:04:50.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:50.844 "dma_device_type": 2 00:04:50.844 } 00:04:50.844 ], 00:04:50.844 "driver_specific": {} 00:04:50.844 }, 00:04:50.844 { 00:04:50.844 "name": "Passthru0", 00:04:50.844 "aliases": [ 00:04:50.844 "c948fdc3-c84c-562a-a271-bcc7768dc51f" 00:04:50.844 ], 00:04:50.844 "product_name": "passthru", 00:04:50.844 "block_size": 512, 00:04:50.844 "num_blocks": 16384, 00:04:50.844 "uuid": "c948fdc3-c84c-562a-a271-bcc7768dc51f", 00:04:50.844 "assigned_rate_limits": { 00:04:50.844 "rw_ios_per_sec": 0, 00:04:50.844 "rw_mbytes_per_sec": 0, 00:04:50.844 "r_mbytes_per_sec": 0, 00:04:50.844 "w_mbytes_per_sec": 0 00:04:50.844 }, 00:04:50.844 "claimed": false, 00:04:50.844 "zoned": false, 00:04:50.844 "supported_io_types": { 00:04:50.844 "read": true, 00:04:50.844 "write": true, 00:04:50.844 "unmap": true, 00:04:50.844 "write_zeroes": true, 00:04:50.844 "flush": true, 00:04:50.844 "reset": true, 00:04:50.844 "compare": false, 00:04:50.844 "compare_and_write": false, 00:04:50.844 "abort": true, 00:04:50.844 "nvme_admin": false, 00:04:50.844 "nvme_io": false 00:04:50.844 }, 00:04:50.844 "memory_domains": [ 00:04:50.844 { 00:04:50.844 "dma_device_id": "system", 00:04:50.844 "dma_device_type": 1 00:04:50.844 }, 00:04:50.844 { 00:04:50.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:50.844 "dma_device_type": 2 00:04:50.844 } 00:04:50.844 ], 00:04:50.844 "driver_specific": { 00:04:50.844 "passthru": { 00:04:50.844 "name": "Passthru0", 00:04:50.844 "base_bdev_name": "Malloc2" 00:04:50.844 } 00:04:50.844 } 00:04:50.844 } 00:04:50.844 ]' 00:04:50.844 19:11:37 -- rpc/rpc.sh@21 -- # jq length 00:04:50.844 19:11:37 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:50.844 19:11:37 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:50.844 19:11:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 19:11:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:50.844 19:11:37 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:50.844 19:11:37 -- rpc/rpc.sh@26 -- # jq length 00:04:50.844 19:11:37 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:50.844 00:04:50.844 real 0m0.247s 00:04:50.844 user 0m0.158s 00:04:50.844 sys 0m0.027s 00:04:50.844 19:11:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:50.844 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:04:50.844 ************************************ 00:04:50.844 END TEST rpc_daemon_integrity 00:04:50.844 ************************************ 00:04:50.844 19:11:37 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:50.844 19:11:37 -- rpc/rpc.sh@84 -- # killprocess 2879391 00:04:50.844 19:11:37 -- common/autotest_common.sh@936 -- # '[' -z 2879391 ']' 00:04:50.844 19:11:37 -- common/autotest_common.sh@940 -- # kill -0 2879391 00:04:50.844 19:11:37 -- common/autotest_common.sh@941 -- # uname 00:04:50.844 19:11:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.844 19:11:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879391 00:04:51.102 19:11:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:51.102 19:11:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:51.102 19:11:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879391' 00:04:51.102 killing process with pid 2879391 00:04:51.102 19:11:37 -- common/autotest_common.sh@955 -- # kill 2879391 00:04:51.102 19:11:37 -- common/autotest_common.sh@960 -- # wait 2879391 00:04:51.359 00:04:51.359 real 0m3.008s 00:04:51.359 user 0m3.764s 00:04:51.359 sys 0m1.032s 00:04:51.359 19:11:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:51.359 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:04:51.359 ************************************ 00:04:51.359 END TEST rpc 00:04:51.359 ************************************ 00:04:51.359 19:11:38 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:51.359 19:11:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.359 19:11:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.359 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:04:51.617 ************************************ 00:04:51.617 START TEST skip_rpc 00:04:51.617 ************************************ 00:04:51.617 19:11:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:51.617 * Looking for test storage... 00:04:51.617 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:51.617 19:11:38 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:51.617 19:11:38 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:51.617 19:11:38 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:51.617 19:11:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.617 19:11:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.617 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:04:51.875 ************************************ 00:04:51.875 START TEST skip_rpc 00:04:51.875 ************************************ 00:04:51.875 19:11:38 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:04:51.875 19:11:38 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=2879978 00:04:51.875 19:11:38 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:51.875 19:11:38 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:51.875 19:11:38 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:51.875 [2024-04-24 19:11:38.801600] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:04:51.875 [2024-04-24 19:11:38.801641] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2879978 ] 00:04:51.875 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.875 [2024-04-24 19:11:38.870333] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:52.133 [2024-04-24 19:11:38.957305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.395 19:11:43 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:57.395 19:11:43 -- common/autotest_common.sh@638 -- # local es=0 00:04:57.395 19:11:43 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:57.395 19:11:43 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:04:57.395 19:11:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:57.395 19:11:43 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:04:57.395 19:11:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:57.395 19:11:43 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:04:57.395 19:11:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:57.395 19:11:43 -- common/autotest_common.sh@10 -- # set +x 00:04:57.395 19:11:43 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:57.395 19:11:43 -- common/autotest_common.sh@641 -- # es=1 00:04:57.395 19:11:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:57.395 19:11:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:57.395 19:11:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:57.395 19:11:43 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:57.395 19:11:43 -- rpc/skip_rpc.sh@23 -- # killprocess 2879978 00:04:57.395 19:11:43 -- common/autotest_common.sh@936 -- # '[' -z 2879978 ']' 00:04:57.395 19:11:43 -- common/autotest_common.sh@940 -- # kill -0 2879978 00:04:57.395 19:11:43 -- common/autotest_common.sh@941 -- # uname 00:04:57.395 19:11:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:57.395 19:11:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2879978 00:04:57.395 19:11:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:57.395 19:11:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:57.395 19:11:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2879978' 00:04:57.395 killing process with pid 2879978 00:04:57.395 19:11:43 -- common/autotest_common.sh@955 -- # kill 2879978 00:04:57.395 19:11:43 -- common/autotest_common.sh@960 -- # wait 2879978 00:04:57.395 00:04:57.395 real 0m5.453s 00:04:57.395 user 0m5.177s 00:04:57.395 sys 0m0.310s 00:04:57.395 19:11:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:57.395 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:04:57.395 ************************************ 00:04:57.395 END TEST skip_rpc 00:04:57.395 ************************************ 00:04:57.395 19:11:44 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:57.395 19:11:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.395 19:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.395 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:04:57.652 ************************************ 00:04:57.652 START TEST skip_rpc_with_json 00:04:57.652 ************************************ 00:04:57.652 19:11:44 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:04:57.652 19:11:44 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:57.652 19:11:44 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:57.652 19:11:44 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=2880751 00:04:57.652 19:11:44 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:57.652 19:11:44 -- rpc/skip_rpc.sh@31 -- # waitforlisten 2880751 00:04:57.652 19:11:44 -- common/autotest_common.sh@817 -- # '[' -z 2880751 ']' 00:04:57.652 19:11:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.652 19:11:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:57.652 19:11:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.652 19:11:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:57.652 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:04:57.652 [2024-04-24 19:11:44.467029] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:04:57.652 [2024-04-24 19:11:44.467082] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2880751 ] 00:04:57.652 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.652 [2024-04-24 19:11:44.537758] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.652 [2024-04-24 19:11:44.630793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.584 19:11:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:58.584 19:11:45 -- common/autotest_common.sh@850 -- # return 0 00:04:58.584 19:11:45 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:58.584 19:11:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:58.584 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:04:58.584 [2024-04-24 19:11:45.281775] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:58.584 request: 00:04:58.584 { 00:04:58.584 "trtype": "tcp", 00:04:58.584 "method": "nvmf_get_transports", 00:04:58.584 "req_id": 1 00:04:58.584 } 00:04:58.584 Got JSON-RPC error response 00:04:58.584 response: 00:04:58.584 { 00:04:58.584 "code": -19, 00:04:58.584 "message": "No such device" 00:04:58.584 } 00:04:58.584 19:11:45 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:58.584 19:11:45 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:58.584 19:11:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:58.584 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:04:58.584 [2024-04-24 19:11:45.293885] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:58.584 19:11:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:58.584 19:11:45 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:58.584 19:11:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:58.584 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:04:58.584 19:11:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:58.584 19:11:45 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:58.584 { 00:04:58.584 "subsystems": [ 00:04:58.584 { 00:04:58.584 "subsystem": "keyring", 00:04:58.584 "config": [] 00:04:58.584 }, 00:04:58.584 { 00:04:58.584 "subsystem": "iobuf", 00:04:58.584 "config": [ 00:04:58.584 { 00:04:58.584 "method": "iobuf_set_options", 00:04:58.584 "params": { 00:04:58.584 "small_pool_count": 8192, 00:04:58.584 "large_pool_count": 1024, 00:04:58.584 "small_bufsize": 8192, 00:04:58.584 "large_bufsize": 135168 00:04:58.584 } 00:04:58.584 } 00:04:58.584 ] 00:04:58.584 }, 00:04:58.584 { 00:04:58.584 "subsystem": "sock", 00:04:58.584 "config": [ 00:04:58.584 { 00:04:58.584 "method": "sock_impl_set_options", 00:04:58.584 "params": { 00:04:58.584 "impl_name": "posix", 00:04:58.584 "recv_buf_size": 2097152, 00:04:58.584 "send_buf_size": 2097152, 00:04:58.584 "enable_recv_pipe": true, 00:04:58.584 "enable_quickack": false, 00:04:58.584 "enable_placement_id": 0, 00:04:58.584 "enable_zerocopy_send_server": true, 00:04:58.584 "enable_zerocopy_send_client": false, 00:04:58.584 "zerocopy_threshold": 0, 00:04:58.584 "tls_version": 0, 00:04:58.584 "enable_ktls": false 00:04:58.584 } 00:04:58.584 }, 00:04:58.584 { 00:04:58.584 "method": "sock_impl_set_options", 00:04:58.584 "params": { 00:04:58.584 "impl_name": "ssl", 00:04:58.584 "recv_buf_size": 4096, 00:04:58.584 "send_buf_size": 4096, 00:04:58.584 "enable_recv_pipe": true, 00:04:58.584 "enable_quickack": false, 00:04:58.584 "enable_placement_id": 0, 00:04:58.584 "enable_zerocopy_send_server": true, 00:04:58.584 "enable_zerocopy_send_client": false, 00:04:58.584 "zerocopy_threshold": 0, 00:04:58.584 "tls_version": 0, 00:04:58.584 "enable_ktls": false 00:04:58.584 } 00:04:58.584 } 00:04:58.584 ] 00:04:58.584 }, 00:04:58.584 { 00:04:58.584 "subsystem": "vmd", 00:04:58.584 "config": [] 00:04:58.584 }, 00:04:58.585 { 00:04:58.585 "subsystem": "accel", 00:04:58.585 "config": [ 00:04:58.585 { 00:04:58.585 "method": "accel_set_options", 00:04:58.585 "params": { 00:04:58.585 "small_cache_size": 128, 00:04:58.585 "large_cache_size": 16, 00:04:58.585 "task_count": 2048, 00:04:58.585 "sequence_count": 2048, 00:04:58.585 "buf_count": 2048 00:04:58.585 } 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "bdev", 00:04:58.585 "config": [ 00:04:58.585 { 00:04:58.585 "method": "bdev_set_options", 00:04:58.585 "params": { 00:04:58.585 "bdev_io_pool_size": 65535, 00:04:58.585 "bdev_io_cache_size": 256, 00:04:58.585 "bdev_auto_examine": true, 00:04:58.585 "iobuf_small_cache_size": 128, 00:04:58.585 "iobuf_large_cache_size": 16 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "bdev_raid_set_options", 00:04:58.585 "params": { 00:04:58.585 "process_window_size_kb": 1024 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "bdev_iscsi_set_options", 00:04:58.585 "params": { 00:04:58.585 "timeout_sec": 30 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "bdev_nvme_set_options", 00:04:58.585 "params": { 00:04:58.585 "action_on_timeout": "none", 00:04:58.585 "timeout_us": 0, 00:04:58.585 "timeout_admin_us": 0, 00:04:58.585 "keep_alive_timeout_ms": 10000, 00:04:58.585 "arbitration_burst": 0, 00:04:58.585 "low_priority_weight": 0, 00:04:58.585 "medium_priority_weight": 0, 00:04:58.585 "high_priority_weight": 0, 00:04:58.585 "nvme_adminq_poll_period_us": 10000, 00:04:58.585 "nvme_ioq_poll_period_us": 0, 00:04:58.585 "io_queue_requests": 0, 00:04:58.585 "delay_cmd_submit": true, 00:04:58.585 "transport_retry_count": 4, 00:04:58.585 "bdev_retry_count": 3, 00:04:58.585 "transport_ack_timeout": 0, 00:04:58.585 "ctrlr_loss_timeout_sec": 0, 00:04:58.585 "reconnect_delay_sec": 0, 00:04:58.585 "fast_io_fail_timeout_sec": 0, 00:04:58.585 "disable_auto_failback": false, 00:04:58.585 "generate_uuids": false, 00:04:58.585 "transport_tos": 0, 00:04:58.585 "nvme_error_stat": false, 00:04:58.585 "rdma_srq_size": 0, 00:04:58.585 "io_path_stat": false, 00:04:58.585 "allow_accel_sequence": false, 00:04:58.585 "rdma_max_cq_size": 0, 00:04:58.585 "rdma_cm_event_timeout_ms": 0, 00:04:58.585 "dhchap_digests": [ 00:04:58.585 "sha256", 00:04:58.585 "sha384", 00:04:58.585 "sha512" 00:04:58.585 ], 00:04:58.585 "dhchap_dhgroups": [ 00:04:58.585 "null", 00:04:58.585 "ffdhe2048", 00:04:58.585 "ffdhe3072", 00:04:58.585 "ffdhe4096", 00:04:58.585 "ffdhe6144", 00:04:58.585 "ffdhe8192" 00:04:58.585 ] 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "bdev_nvme_set_hotplug", 00:04:58.585 "params": { 00:04:58.585 "period_us": 100000, 00:04:58.585 "enable": false 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "bdev_wait_for_examine" 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "scsi", 00:04:58.585 "config": null 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "scheduler", 00:04:58.585 "config": [ 00:04:58.585 { 00:04:58.585 "method": "framework_set_scheduler", 00:04:58.585 "params": { 00:04:58.585 "name": "static" 00:04:58.585 } 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "vhost_scsi", 00:04:58.585 "config": [] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "vhost_blk", 00:04:58.585 "config": [] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "ublk", 00:04:58.585 "config": [] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "nbd", 00:04:58.585 "config": [] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "nvmf", 00:04:58.585 "config": [ 00:04:58.585 { 00:04:58.585 "method": "nvmf_set_config", 00:04:58.585 "params": { 00:04:58.585 "discovery_filter": "match_any", 00:04:58.585 "admin_cmd_passthru": { 00:04:58.585 "identify_ctrlr": false 00:04:58.585 } 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "nvmf_set_max_subsystems", 00:04:58.585 "params": { 00:04:58.585 "max_subsystems": 1024 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "nvmf_set_crdt", 00:04:58.585 "params": { 00:04:58.585 "crdt1": 0, 00:04:58.585 "crdt2": 0, 00:04:58.585 "crdt3": 0 00:04:58.585 } 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "method": "nvmf_create_transport", 00:04:58.585 "params": { 00:04:58.585 "trtype": "TCP", 00:04:58.585 "max_queue_depth": 128, 00:04:58.585 "max_io_qpairs_per_ctrlr": 127, 00:04:58.585 "in_capsule_data_size": 4096, 00:04:58.585 "max_io_size": 131072, 00:04:58.585 "io_unit_size": 131072, 00:04:58.585 "max_aq_depth": 128, 00:04:58.585 "num_shared_buffers": 511, 00:04:58.585 "buf_cache_size": 4294967295, 00:04:58.585 "dif_insert_or_strip": false, 00:04:58.585 "zcopy": false, 00:04:58.585 "c2h_success": true, 00:04:58.585 "sock_priority": 0, 00:04:58.585 "abort_timeout_sec": 1, 00:04:58.585 "ack_timeout": 0, 00:04:58.585 "data_wr_pool_size": 0 00:04:58.585 } 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 }, 00:04:58.585 { 00:04:58.585 "subsystem": "iscsi", 00:04:58.585 "config": [ 00:04:58.585 { 00:04:58.585 "method": "iscsi_set_options", 00:04:58.585 "params": { 00:04:58.585 "node_base": "iqn.2016-06.io.spdk", 00:04:58.585 "max_sessions": 128, 00:04:58.585 "max_connections_per_session": 2, 00:04:58.585 "max_queue_depth": 64, 00:04:58.585 "default_time2wait": 2, 00:04:58.585 "default_time2retain": 20, 00:04:58.585 "first_burst_length": 8192, 00:04:58.585 "immediate_data": true, 00:04:58.585 "allow_duplicated_isid": false, 00:04:58.585 "error_recovery_level": 0, 00:04:58.585 "nop_timeout": 60, 00:04:58.585 "nop_in_interval": 30, 00:04:58.585 "disable_chap": false, 00:04:58.585 "require_chap": false, 00:04:58.585 "mutual_chap": false, 00:04:58.585 "chap_group": 0, 00:04:58.585 "max_large_datain_per_connection": 64, 00:04:58.585 "max_r2t_per_connection": 4, 00:04:58.585 "pdu_pool_size": 36864, 00:04:58.585 "immediate_data_pool_size": 16384, 00:04:58.585 "data_out_pool_size": 2048 00:04:58.585 } 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 } 00:04:58.585 ] 00:04:58.585 } 00:04:58.585 19:11:45 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:58.585 19:11:45 -- rpc/skip_rpc.sh@40 -- # killprocess 2880751 00:04:58.585 19:11:45 -- common/autotest_common.sh@936 -- # '[' -z 2880751 ']' 00:04:58.585 19:11:45 -- common/autotest_common.sh@940 -- # kill -0 2880751 00:04:58.585 19:11:45 -- common/autotest_common.sh@941 -- # uname 00:04:58.585 19:11:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:58.585 19:11:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2880751 00:04:58.585 19:11:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:58.585 19:11:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:58.585 19:11:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2880751' 00:04:58.585 killing process with pid 2880751 00:04:58.585 19:11:45 -- common/autotest_common.sh@955 -- # kill 2880751 00:04:58.585 19:11:45 -- common/autotest_common.sh@960 -- # wait 2880751 00:04:59.157 19:11:45 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=2880978 00:04:59.157 19:11:45 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:59.157 19:11:45 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:04.411 19:11:50 -- rpc/skip_rpc.sh@50 -- # killprocess 2880978 00:05:04.411 19:11:50 -- common/autotest_common.sh@936 -- # '[' -z 2880978 ']' 00:05:04.411 19:11:50 -- common/autotest_common.sh@940 -- # kill -0 2880978 00:05:04.411 19:11:50 -- common/autotest_common.sh@941 -- # uname 00:05:04.411 19:11:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.411 19:11:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2880978 00:05:04.411 19:11:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.411 19:11:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.411 19:11:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2880978' 00:05:04.411 killing process with pid 2880978 00:05:04.411 19:11:50 -- common/autotest_common.sh@955 -- # kill 2880978 00:05:04.411 19:11:50 -- common/autotest_common.sh@960 -- # wait 2880978 00:05:04.411 19:11:51 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:04.411 19:11:51 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:04.411 00:05:04.411 real 0m6.899s 00:05:04.411 user 0m6.649s 00:05:04.411 sys 0m0.699s 00:05:04.411 19:11:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.411 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:04.411 ************************************ 00:05:04.411 END TEST skip_rpc_with_json 00:05:04.411 ************************************ 00:05:04.411 19:11:51 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:05:04.411 19:11:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.411 19:11:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.411 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:04.669 ************************************ 00:05:04.669 START TEST skip_rpc_with_delay 00:05:04.669 ************************************ 00:05:04.669 19:11:51 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:05:04.669 19:11:51 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:04.669 19:11:51 -- common/autotest_common.sh@638 -- # local es=0 00:05:04.669 19:11:51 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:04.669 19:11:51 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:04.669 19:11:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:04.669 19:11:51 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:04.669 19:11:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:04.669 19:11:51 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:04.669 19:11:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:04.669 19:11:51 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:04.669 19:11:51 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:04.669 19:11:51 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:04.669 [2024-04-24 19:11:51.582527] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:05:04.669 [2024-04-24 19:11:51.582615] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:05:04.669 19:11:51 -- common/autotest_common.sh@641 -- # es=1 00:05:04.669 19:11:51 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:04.669 19:11:51 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:04.669 19:11:51 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:04.669 00:05:04.669 real 0m0.067s 00:05:04.669 user 0m0.035s 00:05:04.669 sys 0m0.032s 00:05:04.669 19:11:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.669 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:04.669 ************************************ 00:05:04.669 END TEST skip_rpc_with_delay 00:05:04.669 ************************************ 00:05:04.669 19:11:51 -- rpc/skip_rpc.sh@77 -- # uname 00:05:04.669 19:11:51 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:05:04.669 19:11:51 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:05:04.669 19:11:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.669 19:11:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.669 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:04.927 ************************************ 00:05:04.928 START TEST exit_on_failed_rpc_init 00:05:04.928 ************************************ 00:05:04.928 19:11:51 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:05:04.928 19:11:51 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=2881895 00:05:04.928 19:11:51 -- rpc/skip_rpc.sh@63 -- # waitforlisten 2881895 00:05:04.928 19:11:51 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:04.928 19:11:51 -- common/autotest_common.sh@817 -- # '[' -z 2881895 ']' 00:05:04.928 19:11:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.928 19:11:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:04.928 19:11:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.928 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.928 19:11:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:04.928 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:04.928 [2024-04-24 19:11:51.845851] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:04.928 [2024-04-24 19:11:51.845909] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2881895 ] 00:05:04.928 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.928 [2024-04-24 19:11:51.916655] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.185 [2024-04-24 19:11:52.007282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.749 19:11:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:05.749 19:11:52 -- common/autotest_common.sh@850 -- # return 0 00:05:05.749 19:11:52 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:05.749 19:11:52 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:05.749 19:11:52 -- common/autotest_common.sh@638 -- # local es=0 00:05:05.749 19:11:52 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:05.749 19:11:52 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:05.749 19:11:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:05.749 19:11:52 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:05.749 19:11:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:05.749 19:11:52 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:05.749 19:11:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:05.749 19:11:52 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:05.749 19:11:52 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:05.749 19:11:52 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:05.749 [2024-04-24 19:11:52.705999] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:05.749 [2024-04-24 19:11:52.706058] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2881948 ] 00:05:05.749 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.007 [2024-04-24 19:11:52.779046] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.007 [2024-04-24 19:11:52.860006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:06.007 [2024-04-24 19:11:52.860089] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:05:06.007 [2024-04-24 19:11:52.860102] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:05:06.007 [2024-04-24 19:11:52.860110] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:06.007 19:11:52 -- common/autotest_common.sh@641 -- # es=234 00:05:06.007 19:11:52 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:06.007 19:11:52 -- common/autotest_common.sh@650 -- # es=106 00:05:06.007 19:11:52 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:06.007 19:11:52 -- common/autotest_common.sh@658 -- # es=1 00:05:06.007 19:11:52 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:06.007 19:11:52 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:05:06.007 19:11:52 -- rpc/skip_rpc.sh@70 -- # killprocess 2881895 00:05:06.007 19:11:52 -- common/autotest_common.sh@936 -- # '[' -z 2881895 ']' 00:05:06.007 19:11:52 -- common/autotest_common.sh@940 -- # kill -0 2881895 00:05:06.007 19:11:52 -- common/autotest_common.sh@941 -- # uname 00:05:06.007 19:11:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:06.007 19:11:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2881895 00:05:06.007 19:11:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:06.007 19:11:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:06.007 19:11:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2881895' 00:05:06.007 killing process with pid 2881895 00:05:06.007 19:11:53 -- common/autotest_common.sh@955 -- # kill 2881895 00:05:06.007 19:11:53 -- common/autotest_common.sh@960 -- # wait 2881895 00:05:06.575 00:05:06.575 real 0m1.612s 00:05:06.575 user 0m1.825s 00:05:06.575 sys 0m0.490s 00:05:06.575 19:11:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:06.575 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:06.575 ************************************ 00:05:06.575 END TEST exit_on_failed_rpc_init 00:05:06.575 ************************************ 00:05:06.575 19:11:53 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:06.575 00:05:06.575 real 0m14.957s 00:05:06.575 user 0m14.013s 00:05:06.575 sys 0m2.075s 00:05:06.575 19:11:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:06.575 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:06.575 ************************************ 00:05:06.575 END TEST skip_rpc 00:05:06.575 ************************************ 00:05:06.575 19:11:53 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:06.575 19:11:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.575 19:11:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.575 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:06.833 ************************************ 00:05:06.833 START TEST rpc_client 00:05:06.833 ************************************ 00:05:06.833 19:11:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:06.833 * Looking for test storage... 00:05:06.833 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:05:06.833 19:11:53 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:06.833 OK 00:05:06.833 19:11:53 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:06.833 00:05:06.833 real 0m0.122s 00:05:06.833 user 0m0.047s 00:05:06.833 sys 0m0.082s 00:05:06.833 19:11:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:06.833 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:06.833 ************************************ 00:05:06.833 END TEST rpc_client 00:05:06.833 ************************************ 00:05:06.833 19:11:53 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:06.833 19:11:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.833 19:11:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.833 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:07.092 ************************************ 00:05:07.092 START TEST json_config 00:05:07.092 ************************************ 00:05:07.092 19:11:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:07.092 19:11:54 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:05:07.092 19:11:54 -- nvmf/common.sh@7 -- # uname -s 00:05:07.092 19:11:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:07.092 19:11:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:07.092 19:11:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:07.092 19:11:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:07.092 19:11:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:07.092 19:11:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:07.092 19:11:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:07.093 19:11:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:07.093 19:11:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:07.093 19:11:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:07.093 19:11:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:05:07.093 19:11:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:05:07.093 19:11:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:07.093 19:11:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:07.093 19:11:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:07.093 19:11:54 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:07.093 19:11:54 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:05:07.093 19:11:54 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:07.093 19:11:54 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:07.093 19:11:54 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:07.093 19:11:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:07.093 19:11:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:07.093 19:11:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:07.093 19:11:54 -- paths/export.sh@5 -- # export PATH 00:05:07.093 19:11:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:07.093 19:11:54 -- nvmf/common.sh@47 -- # : 0 00:05:07.093 19:11:54 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:07.093 19:11:54 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:07.093 19:11:54 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:07.093 19:11:54 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:07.093 19:11:54 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:07.093 19:11:54 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:07.093 19:11:54 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:07.093 19:11:54 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:07.093 19:11:54 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:05:07.093 19:11:54 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:05:07.093 19:11:54 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:05:07.093 19:11:54 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:05:07.093 19:11:54 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:07.093 19:11:54 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:05:07.093 19:11:54 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:05:07.093 19:11:54 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:07.093 19:11:54 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:05:07.093 19:11:54 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:07.093 19:11:54 -- json_config/json_config.sh@33 -- # declare -A app_params 00:05:07.093 19:11:54 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:05:07.093 19:11:54 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:05:07.093 19:11:54 -- json_config/json_config.sh@40 -- # last_event_id=0 00:05:07.093 19:11:54 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:07.093 19:11:54 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:05:07.093 INFO: JSON configuration test init 00:05:07.093 19:11:54 -- json_config/json_config.sh@357 -- # json_config_test_init 00:05:07.093 19:11:54 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:05:07.093 19:11:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:07.093 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:07.093 19:11:54 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:05:07.093 19:11:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:07.093 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:07.093 19:11:54 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:05:07.093 19:11:54 -- json_config/common.sh@9 -- # local app=target 00:05:07.093 19:11:54 -- json_config/common.sh@10 -- # shift 00:05:07.093 19:11:54 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:07.093 19:11:54 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:07.093 19:11:54 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:07.093 19:11:54 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:07.093 19:11:54 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:07.093 19:11:54 -- json_config/common.sh@22 -- # app_pid["$app"]=2882323 00:05:07.093 19:11:54 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:07.093 Waiting for target to run... 00:05:07.093 19:11:54 -- json_config/common.sh@25 -- # waitforlisten 2882323 /var/tmp/spdk_tgt.sock 00:05:07.093 19:11:54 -- common/autotest_common.sh@817 -- # '[' -z 2882323 ']' 00:05:07.093 19:11:54 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:07.093 19:11:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:07.093 19:11:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:07.093 19:11:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:07.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:07.093 19:11:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:07.093 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:07.352 [2024-04-24 19:11:54.159324] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:07.352 [2024-04-24 19:11:54.159391] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2882323 ] 00:05:07.352 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.919 [2024-04-24 19:11:54.681008] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.919 [2024-04-24 19:11:54.776073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.177 19:11:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:08.177 19:11:54 -- common/autotest_common.sh@850 -- # return 0 00:05:08.177 19:11:54 -- json_config/common.sh@26 -- # echo '' 00:05:08.177 00:05:08.177 19:11:54 -- json_config/json_config.sh@269 -- # create_accel_config 00:05:08.177 19:11:54 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:05:08.177 19:11:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:08.177 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:08.177 19:11:54 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:05:08.177 19:11:54 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:05:08.177 19:11:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:08.177 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:08.177 19:11:55 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:08.177 19:11:55 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:05:08.177 19:11:55 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:11.459 19:11:58 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:05:11.459 19:11:58 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:05:11.459 19:11:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:11.459 19:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:11.459 19:11:58 -- json_config/json_config.sh@45 -- # local ret=0 00:05:11.459 19:11:58 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:11.459 19:11:58 -- json_config/json_config.sh@46 -- # local enabled_types 00:05:11.459 19:11:58 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:05:11.459 19:11:58 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:05:11.459 19:11:58 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:11.459 19:11:58 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:11.459 19:11:58 -- json_config/json_config.sh@48 -- # local get_types 00:05:11.459 19:11:58 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:05:11.459 19:11:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:11.459 19:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:11.459 19:11:58 -- json_config/json_config.sh@55 -- # return 0 00:05:11.459 19:11:58 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:05:11.459 19:11:58 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:05:11.459 19:11:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:11.459 19:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:11.459 19:11:58 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:11.459 19:11:58 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:05:11.459 19:11:58 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:05:11.459 19:11:58 -- json_config/json_config.sh@234 -- # nvmftestinit 00:05:11.459 19:11:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:05:11.459 19:11:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:11.459 19:11:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:05:11.459 19:11:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:05:11.459 19:11:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:05:11.459 19:11:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:11.460 19:11:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:05:11.460 19:11:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:11.460 19:11:58 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:05:11.460 19:11:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:05:11.460 19:11:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:05:11.460 19:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:18.023 19:12:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:05:18.023 19:12:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:05:18.023 19:12:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:05:18.023 19:12:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:05:18.023 19:12:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:05:18.023 19:12:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:05:18.023 19:12:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:05:18.023 19:12:04 -- nvmf/common.sh@295 -- # net_devs=() 00:05:18.023 19:12:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:05:18.023 19:12:04 -- nvmf/common.sh@296 -- # e810=() 00:05:18.023 19:12:04 -- nvmf/common.sh@296 -- # local -ga e810 00:05:18.023 19:12:04 -- nvmf/common.sh@297 -- # x722=() 00:05:18.023 19:12:04 -- nvmf/common.sh@297 -- # local -ga x722 00:05:18.023 19:12:04 -- nvmf/common.sh@298 -- # mlx=() 00:05:18.023 19:12:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:05:18.023 19:12:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:05:18.023 19:12:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:05:18.023 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:05:18.023 19:12:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:05:18.023 19:12:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:05:18.023 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:05:18.023 19:12:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:05:18.023 19:12:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:18.023 19:12:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:18.023 19:12:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:05:18.023 Found net devices under 0000:18:00.0: mlx_0_0 00:05:18.023 19:12:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:18.023 19:12:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:18.023 19:12:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:05:18.023 Found net devices under 0000:18:00.1: mlx_0_1 00:05:18.023 19:12:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:05:18.023 19:12:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:05:18.023 19:12:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:05:18.023 19:12:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:05:18.023 19:12:04 -- nvmf/common.sh@58 -- # uname 00:05:18.023 19:12:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:05:18.023 19:12:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:05:18.023 19:12:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:05:18.023 19:12:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:05:18.023 19:12:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:05:18.023 19:12:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:05:18.023 19:12:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:05:18.023 19:12:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:05:18.023 19:12:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:05:18.023 19:12:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:05:18.023 19:12:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:05:18.023 19:12:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:05:18.023 19:12:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:05:18.023 19:12:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:05:18.023 19:12:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:05:18.023 19:12:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:05:18.023 19:12:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:05:18.023 19:12:04 -- nvmf/common.sh@105 -- # continue 2 00:05:18.023 19:12:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.023 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:05:18.023 19:12:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:05:18.023 19:12:04 -- nvmf/common.sh@105 -- # continue 2 00:05:18.023 19:12:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:05:18.023 19:12:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:05:18.023 19:12:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:05:18.023 19:12:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:05:18.023 19:12:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:18.023 19:12:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:18.023 19:12:04 -- nvmf/common.sh@74 -- # ip= 00:05:18.023 19:12:04 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:05:18.024 19:12:04 -- nvmf/common.sh@77 -- # ip link set mlx_0_0 up 00:05:18.024 19:12:04 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:05:18.024 19:12:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:05:18.024 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:05:18.024 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:05:18.024 altname enp24s0f0np0 00:05:18.024 altname ens785f0np0 00:05:18.024 inet 192.168.100.8/24 scope global mlx_0_0 00:05:18.024 valid_lft forever preferred_lft forever 00:05:18.024 19:12:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:05:18.024 19:12:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:18.024 19:12:04 -- nvmf/common.sh@74 -- # ip= 00:05:18.024 19:12:04 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@77 -- # ip link set mlx_0_1 up 00:05:18.024 19:12:04 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:05:18.024 19:12:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:05:18.024 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:05:18.024 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:05:18.024 altname enp24s0f1np1 00:05:18.024 altname ens785f1np1 00:05:18.024 inet 192.168.100.9/24 scope global mlx_0_1 00:05:18.024 valid_lft forever preferred_lft forever 00:05:18.024 19:12:04 -- nvmf/common.sh@411 -- # return 0 00:05:18.024 19:12:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:05:18.024 19:12:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:05:18.024 19:12:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:05:18.024 19:12:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:05:18.024 19:12:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:05:18.024 19:12:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:05:18.024 19:12:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:05:18.024 19:12:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:05:18.024 19:12:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:05:18.024 19:12:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:18.024 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.024 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:05:18.024 19:12:04 -- nvmf/common.sh@105 -- # continue 2 00:05:18.024 19:12:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:18.024 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.024 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:18.024 19:12:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:05:18.024 19:12:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@105 -- # continue 2 00:05:18.024 19:12:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:05:18.024 19:12:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:05:18.024 19:12:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:18.024 19:12:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:05:18.024 19:12:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:05:18.024 19:12:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:18.024 19:12:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:05:18.024 192.168.100.9' 00:05:18.024 19:12:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:05:18.024 192.168.100.9' 00:05:18.024 19:12:04 -- nvmf/common.sh@446 -- # head -n 1 00:05:18.024 19:12:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:05:18.024 19:12:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:05:18.024 192.168.100.9' 00:05:18.024 19:12:04 -- nvmf/common.sh@447 -- # tail -n +2 00:05:18.024 19:12:04 -- nvmf/common.sh@447 -- # head -n 1 00:05:18.024 19:12:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:05:18.024 19:12:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:05:18.024 19:12:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:05:18.024 19:12:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:05:18.024 19:12:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:05:18.024 19:12:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:05:18.024 19:12:05 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:05:18.024 19:12:05 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:18.024 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:18.324 MallocForNvmf0 00:05:18.324 19:12:05 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:18.324 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:18.601 MallocForNvmf1 00:05:18.601 19:12:05 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:05:18.601 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:05:18.601 [2024-04-24 19:12:05.518062] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:05:18.601 [2024-04-24 19:12:05.571054] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1701400/0x184e340) succeed. 00:05:18.601 [2024-04-24 19:12:05.583304] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x17035f0/0x17ae280) succeed. 00:05:18.858 19:12:05 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:18.858 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:18.858 19:12:05 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:18.858 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:19.115 19:12:05 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:19.115 19:12:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:19.115 19:12:06 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:05:19.115 19:12:06 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:05:19.372 [2024-04-24 19:12:06.268594] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:05:19.372 19:12:06 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:05:19.372 19:12:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:19.372 19:12:06 -- common/autotest_common.sh@10 -- # set +x 00:05:19.372 19:12:06 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:05:19.372 19:12:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:19.372 19:12:06 -- common/autotest_common.sh@10 -- # set +x 00:05:19.372 19:12:06 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:05:19.372 19:12:06 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:19.372 19:12:06 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:19.629 MallocBdevForConfigChangeCheck 00:05:19.629 19:12:06 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:05:19.629 19:12:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:19.629 19:12:06 -- common/autotest_common.sh@10 -- # set +x 00:05:19.629 19:12:06 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:05:19.629 19:12:06 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:19.885 19:12:06 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:05:19.885 INFO: shutting down applications... 00:05:19.885 19:12:06 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:05:19.885 19:12:06 -- json_config/json_config.sh@368 -- # json_config_clear target 00:05:19.885 19:12:06 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:05:19.885 19:12:06 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:23.159 Calling clear_iscsi_subsystem 00:05:23.159 Calling clear_nvmf_subsystem 00:05:23.159 Calling clear_nbd_subsystem 00:05:23.159 Calling clear_ublk_subsystem 00:05:23.159 Calling clear_vhost_blk_subsystem 00:05:23.159 Calling clear_vhost_scsi_subsystem 00:05:23.159 Calling clear_bdev_subsystem 00:05:23.159 19:12:09 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:05:23.159 19:12:09 -- json_config/json_config.sh@343 -- # count=100 00:05:23.159 19:12:09 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:05:23.159 19:12:09 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:23.159 19:12:09 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:23.159 19:12:09 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:23.159 19:12:09 -- json_config/json_config.sh@345 -- # break 00:05:23.159 19:12:09 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:05:23.159 19:12:09 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:05:23.159 19:12:09 -- json_config/common.sh@31 -- # local app=target 00:05:23.159 19:12:09 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:05:23.159 19:12:09 -- json_config/common.sh@35 -- # [[ -n 2882323 ]] 00:05:23.159 19:12:09 -- json_config/common.sh@38 -- # kill -SIGINT 2882323 00:05:23.159 19:12:09 -- json_config/common.sh@40 -- # (( i = 0 )) 00:05:23.159 19:12:09 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:23.159 19:12:09 -- json_config/common.sh@41 -- # kill -0 2882323 00:05:23.159 19:12:09 -- json_config/common.sh@45 -- # sleep 0.5 00:05:23.159 [2024-04-24 19:12:09.951781] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:05:23.417 19:12:10 -- json_config/common.sh@40 -- # (( i++ )) 00:05:23.417 19:12:10 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:23.417 19:12:10 -- json_config/common.sh@41 -- # kill -0 2882323 00:05:23.417 19:12:10 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:05:23.417 19:12:10 -- json_config/common.sh@43 -- # break 00:05:23.417 19:12:10 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:05:23.417 19:12:10 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:05:23.417 SPDK target shutdown done 00:05:23.417 19:12:10 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:05:23.417 INFO: relaunching applications... 00:05:23.417 19:12:10 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:23.417 19:12:10 -- json_config/common.sh@9 -- # local app=target 00:05:23.417 19:12:10 -- json_config/common.sh@10 -- # shift 00:05:23.417 19:12:10 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:23.417 19:12:10 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:23.417 19:12:10 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:23.417 19:12:10 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:23.417 19:12:10 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:23.417 19:12:10 -- json_config/common.sh@22 -- # app_pid["$app"]=2887028 00:05:23.417 19:12:10 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:23.417 Waiting for target to run... 00:05:23.417 19:12:10 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:23.417 19:12:10 -- json_config/common.sh@25 -- # waitforlisten 2887028 /var/tmp/spdk_tgt.sock 00:05:23.417 19:12:10 -- common/autotest_common.sh@817 -- # '[' -z 2887028 ']' 00:05:23.417 19:12:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:23.417 19:12:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:23.417 19:12:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:23.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:23.417 19:12:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:23.417 19:12:10 -- common/autotest_common.sh@10 -- # set +x 00:05:23.417 [2024-04-24 19:12:10.398347] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:23.417 [2024-04-24 19:12:10.398419] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2887028 ] 00:05:23.417 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.984 [2024-04-24 19:12:10.913739] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.242 [2024-04-24 19:12:11.010506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.517 [2024-04-24 19:12:14.035173] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1194020/0x11c05c0) succeed. 00:05:27.517 [2024-04-24 19:12:14.046311] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1196210/0x12205c0) succeed. 00:05:27.517 [2024-04-24 19:12:14.097235] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:05:27.774 19:12:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:27.774 19:12:14 -- common/autotest_common.sh@850 -- # return 0 00:05:27.774 19:12:14 -- json_config/common.sh@26 -- # echo '' 00:05:27.774 00:05:27.774 19:12:14 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:05:27.774 19:12:14 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:27.774 INFO: Checking if target configuration is the same... 00:05:27.774 19:12:14 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:27.774 19:12:14 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:05:27.774 19:12:14 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:27.774 + '[' 2 -ne 2 ']' 00:05:27.774 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:27.774 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:05:27.774 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:05:27.774 +++ basename /dev/fd/62 00:05:27.774 ++ mktemp /tmp/62.XXX 00:05:27.774 + tmp_file_1=/tmp/62.xcS 00:05:27.774 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:27.774 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:27.774 + tmp_file_2=/tmp/spdk_tgt_config.json.OBn 00:05:27.774 + ret=0 00:05:27.774 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.031 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.031 + diff -u /tmp/62.xcS /tmp/spdk_tgt_config.json.OBn 00:05:28.031 + echo 'INFO: JSON config files are the same' 00:05:28.031 INFO: JSON config files are the same 00:05:28.031 + rm /tmp/62.xcS /tmp/spdk_tgt_config.json.OBn 00:05:28.031 + exit 0 00:05:28.031 19:12:14 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:05:28.031 19:12:14 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:28.031 INFO: changing configuration and checking if this can be detected... 00:05:28.031 19:12:14 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:28.031 19:12:14 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:28.289 19:12:15 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:05:28.289 19:12:15 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:28.289 19:12:15 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.289 + '[' 2 -ne 2 ']' 00:05:28.289 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:28.289 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:05:28.289 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:05:28.289 +++ basename /dev/fd/62 00:05:28.289 ++ mktemp /tmp/62.XXX 00:05:28.289 + tmp_file_1=/tmp/62.4hB 00:05:28.289 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.289 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:28.289 + tmp_file_2=/tmp/spdk_tgt_config.json.vY9 00:05:28.289 + ret=0 00:05:28.289 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.546 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.546 + diff -u /tmp/62.4hB /tmp/spdk_tgt_config.json.vY9 00:05:28.546 + ret=1 00:05:28.546 + echo '=== Start of file: /tmp/62.4hB ===' 00:05:28.546 + cat /tmp/62.4hB 00:05:28.546 + echo '=== End of file: /tmp/62.4hB ===' 00:05:28.546 + echo '' 00:05:28.546 + echo '=== Start of file: /tmp/spdk_tgt_config.json.vY9 ===' 00:05:28.546 + cat /tmp/spdk_tgt_config.json.vY9 00:05:28.546 + echo '=== End of file: /tmp/spdk_tgt_config.json.vY9 ===' 00:05:28.546 + echo '' 00:05:28.546 + rm /tmp/62.4hB /tmp/spdk_tgt_config.json.vY9 00:05:28.546 + exit 1 00:05:28.546 19:12:15 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:05:28.546 INFO: configuration change detected. 00:05:28.546 19:12:15 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:05:28.546 19:12:15 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:05:28.546 19:12:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:28.546 19:12:15 -- common/autotest_common.sh@10 -- # set +x 00:05:28.546 19:12:15 -- json_config/json_config.sh@307 -- # local ret=0 00:05:28.546 19:12:15 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:05:28.546 19:12:15 -- json_config/json_config.sh@317 -- # [[ -n 2887028 ]] 00:05:28.546 19:12:15 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:05:28.546 19:12:15 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:05:28.546 19:12:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:28.546 19:12:15 -- common/autotest_common.sh@10 -- # set +x 00:05:28.546 19:12:15 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:05:28.546 19:12:15 -- json_config/json_config.sh@193 -- # uname -s 00:05:28.546 19:12:15 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:05:28.546 19:12:15 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:05:28.546 19:12:15 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:05:28.546 19:12:15 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:05:28.546 19:12:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:28.546 19:12:15 -- common/autotest_common.sh@10 -- # set +x 00:05:28.546 19:12:15 -- json_config/json_config.sh@323 -- # killprocess 2887028 00:05:28.546 19:12:15 -- common/autotest_common.sh@936 -- # '[' -z 2887028 ']' 00:05:28.546 19:12:15 -- common/autotest_common.sh@940 -- # kill -0 2887028 00:05:28.546 19:12:15 -- common/autotest_common.sh@941 -- # uname 00:05:28.802 19:12:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.802 19:12:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2887028 00:05:28.802 19:12:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.802 19:12:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.802 19:12:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2887028' 00:05:28.802 killing process with pid 2887028 00:05:28.802 19:12:15 -- common/autotest_common.sh@955 -- # kill 2887028 00:05:28.802 19:12:15 -- common/autotest_common.sh@960 -- # wait 2887028 00:05:28.802 [2024-04-24 19:12:15.729642] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:05:31.325 19:12:18 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.325 19:12:18 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:05:31.325 19:12:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:31.325 19:12:18 -- common/autotest_common.sh@10 -- # set +x 00:05:31.325 19:12:18 -- json_config/json_config.sh@328 -- # return 0 00:05:31.325 19:12:18 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:05:31.325 INFO: Success 00:05:31.325 19:12:18 -- json_config/json_config.sh@1 -- # nvmftestfini 00:05:31.325 19:12:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:05:31.325 19:12:18 -- nvmf/common.sh@117 -- # sync 00:05:31.325 19:12:18 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:05:31.325 19:12:18 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:05:31.325 19:12:18 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:05:31.325 19:12:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:05:31.325 19:12:18 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:05:31.325 00:05:31.325 real 0m24.167s 00:05:31.325 user 0m26.221s 00:05:31.325 sys 0m7.738s 00:05:31.325 19:12:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.325 19:12:18 -- common/autotest_common.sh@10 -- # set +x 00:05:31.325 ************************************ 00:05:31.325 END TEST json_config 00:05:31.325 ************************************ 00:05:31.325 19:12:18 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.325 19:12:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.325 19:12:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.325 19:12:18 -- common/autotest_common.sh@10 -- # set +x 00:05:31.325 ************************************ 00:05:31.325 START TEST json_config_extra_key 00:05:31.325 ************************************ 00:05:31.325 19:12:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:05:31.583 19:12:18 -- nvmf/common.sh@7 -- # uname -s 00:05:31.583 19:12:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:31.583 19:12:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:31.583 19:12:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:31.583 19:12:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:31.583 19:12:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:31.583 19:12:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:31.583 19:12:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:31.583 19:12:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:31.583 19:12:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:31.583 19:12:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:31.583 19:12:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:05:31.583 19:12:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:05:31.583 19:12:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:31.583 19:12:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:31.583 19:12:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:31.583 19:12:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:31.583 19:12:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:05:31.583 19:12:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:31.583 19:12:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:31.583 19:12:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:31.583 19:12:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.583 19:12:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.583 19:12:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.583 19:12:18 -- paths/export.sh@5 -- # export PATH 00:05:31.583 19:12:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.583 19:12:18 -- nvmf/common.sh@47 -- # : 0 00:05:31.583 19:12:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:31.583 19:12:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:31.583 19:12:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:31.583 19:12:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:31.583 19:12:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:31.583 19:12:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:31.583 19:12:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:31.583 19:12:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:05:31.583 INFO: launching applications... 00:05:31.583 19:12:18 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.583 19:12:18 -- json_config/common.sh@9 -- # local app=target 00:05:31.583 19:12:18 -- json_config/common.sh@10 -- # shift 00:05:31.583 19:12:18 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:31.583 19:12:18 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:31.583 19:12:18 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:31.583 19:12:18 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:31.583 19:12:18 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:31.583 19:12:18 -- json_config/common.sh@22 -- # app_pid["$app"]=2888245 00:05:31.583 19:12:18 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:31.583 Waiting for target to run... 00:05:31.583 19:12:18 -- json_config/common.sh@25 -- # waitforlisten 2888245 /var/tmp/spdk_tgt.sock 00:05:31.583 19:12:18 -- common/autotest_common.sh@817 -- # '[' -z 2888245 ']' 00:05:31.583 19:12:18 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.583 19:12:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:31.583 19:12:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:31.583 19:12:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:31.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:31.583 19:12:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:31.583 19:12:18 -- common/autotest_common.sh@10 -- # set +x 00:05:31.583 [2024-04-24 19:12:18.495742] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:31.583 [2024-04-24 19:12:18.495808] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2888245 ] 00:05:31.583 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.839 [2024-04-24 19:12:18.806119] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.095 [2024-04-24 19:12:18.878591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.352 19:12:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:32.352 19:12:19 -- common/autotest_common.sh@850 -- # return 0 00:05:32.352 19:12:19 -- json_config/common.sh@26 -- # echo '' 00:05:32.352 00:05:32.352 19:12:19 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:05:32.352 INFO: shutting down applications... 00:05:32.352 19:12:19 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:05:32.352 19:12:19 -- json_config/common.sh@31 -- # local app=target 00:05:32.352 19:12:19 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:05:32.352 19:12:19 -- json_config/common.sh@35 -- # [[ -n 2888245 ]] 00:05:32.352 19:12:19 -- json_config/common.sh@38 -- # kill -SIGINT 2888245 00:05:32.352 19:12:19 -- json_config/common.sh@40 -- # (( i = 0 )) 00:05:32.352 19:12:19 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:32.352 19:12:19 -- json_config/common.sh@41 -- # kill -0 2888245 00:05:32.352 19:12:19 -- json_config/common.sh@45 -- # sleep 0.5 00:05:32.916 19:12:19 -- json_config/common.sh@40 -- # (( i++ )) 00:05:32.916 19:12:19 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:32.916 19:12:19 -- json_config/common.sh@41 -- # kill -0 2888245 00:05:32.916 19:12:19 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:05:32.916 19:12:19 -- json_config/common.sh@43 -- # break 00:05:32.916 19:12:19 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:05:32.916 19:12:19 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:05:32.916 SPDK target shutdown done 00:05:32.916 19:12:19 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:05:32.916 Success 00:05:32.916 00:05:32.916 real 0m1.467s 00:05:32.916 user 0m1.257s 00:05:32.916 sys 0m0.430s 00:05:32.916 19:12:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:32.916 19:12:19 -- common/autotest_common.sh@10 -- # set +x 00:05:32.916 ************************************ 00:05:32.916 END TEST json_config_extra_key 00:05:32.916 ************************************ 00:05:32.916 19:12:19 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:32.916 19:12:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.916 19:12:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.916 19:12:19 -- common/autotest_common.sh@10 -- # set +x 00:05:33.173 ************************************ 00:05:33.173 START TEST alias_rpc 00:05:33.173 ************************************ 00:05:33.173 19:12:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:33.173 * Looking for test storage... 00:05:33.173 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:05:33.173 19:12:20 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:33.173 19:12:20 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2888595 00:05:33.173 19:12:20 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:33.173 19:12:20 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2888595 00:05:33.173 19:12:20 -- common/autotest_common.sh@817 -- # '[' -z 2888595 ']' 00:05:33.173 19:12:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.173 19:12:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:33.173 19:12:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.173 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.173 19:12:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:33.173 19:12:20 -- common/autotest_common.sh@10 -- # set +x 00:05:33.173 [2024-04-24 19:12:20.159707] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:33.173 [2024-04-24 19:12:20.159766] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2888595 ] 00:05:33.173 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.430 [2024-04-24 19:12:20.231739] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.430 [2024-04-24 19:12:20.320906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.996 19:12:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:33.996 19:12:20 -- common/autotest_common.sh@850 -- # return 0 00:05:33.996 19:12:20 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:34.253 19:12:21 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2888595 00:05:34.253 19:12:21 -- common/autotest_common.sh@936 -- # '[' -z 2888595 ']' 00:05:34.253 19:12:21 -- common/autotest_common.sh@940 -- # kill -0 2888595 00:05:34.253 19:12:21 -- common/autotest_common.sh@941 -- # uname 00:05:34.253 19:12:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.253 19:12:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2888595 00:05:34.253 19:12:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.253 19:12:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.253 19:12:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2888595' 00:05:34.253 killing process with pid 2888595 00:05:34.253 19:12:21 -- common/autotest_common.sh@955 -- # kill 2888595 00:05:34.253 19:12:21 -- common/autotest_common.sh@960 -- # wait 2888595 00:05:34.820 00:05:34.820 real 0m1.584s 00:05:34.820 user 0m1.674s 00:05:34.820 sys 0m0.453s 00:05:34.820 19:12:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:34.820 19:12:21 -- common/autotest_common.sh@10 -- # set +x 00:05:34.820 ************************************ 00:05:34.820 END TEST alias_rpc 00:05:34.820 ************************************ 00:05:34.820 19:12:21 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:05:34.820 19:12:21 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:34.820 19:12:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.820 19:12:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.820 19:12:21 -- common/autotest_common.sh@10 -- # set +x 00:05:34.820 ************************************ 00:05:34.820 START TEST spdkcli_tcp 00:05:34.820 ************************************ 00:05:34.820 19:12:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:35.078 * Looking for test storage... 00:05:35.078 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:05:35.078 19:12:21 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:35.078 19:12:21 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:35.078 19:12:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:35.078 19:12:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2888844 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@27 -- # waitforlisten 2888844 00:05:35.078 19:12:21 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:35.078 19:12:21 -- common/autotest_common.sh@817 -- # '[' -z 2888844 ']' 00:05:35.078 19:12:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.078 19:12:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:35.078 19:12:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.078 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.078 19:12:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:35.078 19:12:21 -- common/autotest_common.sh@10 -- # set +x 00:05:35.078 [2024-04-24 19:12:21.951292] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:35.078 [2024-04-24 19:12:21.951357] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2888844 ] 00:05:35.078 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.078 [2024-04-24 19:12:22.021996] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:35.337 [2024-04-24 19:12:22.102848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:35.337 [2024-04-24 19:12:22.102851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.904 19:12:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:35.904 19:12:22 -- common/autotest_common.sh@850 -- # return 0 00:05:35.904 19:12:22 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:35.904 19:12:22 -- spdkcli/tcp.sh@31 -- # socat_pid=2889021 00:05:35.904 19:12:22 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:35.904 [ 00:05:35.904 "bdev_malloc_delete", 00:05:35.904 "bdev_malloc_create", 00:05:35.904 "bdev_null_resize", 00:05:35.904 "bdev_null_delete", 00:05:35.904 "bdev_null_create", 00:05:35.904 "bdev_nvme_cuse_unregister", 00:05:35.904 "bdev_nvme_cuse_register", 00:05:35.904 "bdev_opal_new_user", 00:05:35.904 "bdev_opal_set_lock_state", 00:05:35.904 "bdev_opal_delete", 00:05:35.904 "bdev_opal_get_info", 00:05:35.904 "bdev_opal_create", 00:05:35.904 "bdev_nvme_opal_revert", 00:05:35.904 "bdev_nvme_opal_init", 00:05:35.904 "bdev_nvme_send_cmd", 00:05:35.904 "bdev_nvme_get_path_iostat", 00:05:35.904 "bdev_nvme_get_mdns_discovery_info", 00:05:35.904 "bdev_nvme_stop_mdns_discovery", 00:05:35.904 "bdev_nvme_start_mdns_discovery", 00:05:35.904 "bdev_nvme_set_multipath_policy", 00:05:35.904 "bdev_nvme_set_preferred_path", 00:05:35.904 "bdev_nvme_get_io_paths", 00:05:35.904 "bdev_nvme_remove_error_injection", 00:05:35.904 "bdev_nvme_add_error_injection", 00:05:35.904 "bdev_nvme_get_discovery_info", 00:05:35.904 "bdev_nvme_stop_discovery", 00:05:35.904 "bdev_nvme_start_discovery", 00:05:35.904 "bdev_nvme_get_controller_health_info", 00:05:35.904 "bdev_nvme_disable_controller", 00:05:35.904 "bdev_nvme_enable_controller", 00:05:35.904 "bdev_nvme_reset_controller", 00:05:35.904 "bdev_nvme_get_transport_statistics", 00:05:35.904 "bdev_nvme_apply_firmware", 00:05:35.904 "bdev_nvme_detach_controller", 00:05:35.904 "bdev_nvme_get_controllers", 00:05:35.904 "bdev_nvme_attach_controller", 00:05:35.904 "bdev_nvme_set_hotplug", 00:05:35.904 "bdev_nvme_set_options", 00:05:35.904 "bdev_passthru_delete", 00:05:35.904 "bdev_passthru_create", 00:05:35.904 "bdev_lvol_grow_lvstore", 00:05:35.904 "bdev_lvol_get_lvols", 00:05:35.904 "bdev_lvol_get_lvstores", 00:05:35.904 "bdev_lvol_delete", 00:05:35.904 "bdev_lvol_set_read_only", 00:05:35.904 "bdev_lvol_resize", 00:05:35.904 "bdev_lvol_decouple_parent", 00:05:35.904 "bdev_lvol_inflate", 00:05:35.904 "bdev_lvol_rename", 00:05:35.904 "bdev_lvol_clone_bdev", 00:05:35.904 "bdev_lvol_clone", 00:05:35.904 "bdev_lvol_snapshot", 00:05:35.904 "bdev_lvol_create", 00:05:35.904 "bdev_lvol_delete_lvstore", 00:05:35.904 "bdev_lvol_rename_lvstore", 00:05:35.904 "bdev_lvol_create_lvstore", 00:05:35.904 "bdev_raid_set_options", 00:05:35.904 "bdev_raid_remove_base_bdev", 00:05:35.904 "bdev_raid_add_base_bdev", 00:05:35.904 "bdev_raid_delete", 00:05:35.904 "bdev_raid_create", 00:05:35.904 "bdev_raid_get_bdevs", 00:05:35.904 "bdev_error_inject_error", 00:05:35.904 "bdev_error_delete", 00:05:35.904 "bdev_error_create", 00:05:35.904 "bdev_split_delete", 00:05:35.904 "bdev_split_create", 00:05:35.904 "bdev_delay_delete", 00:05:35.904 "bdev_delay_create", 00:05:35.904 "bdev_delay_update_latency", 00:05:35.904 "bdev_zone_block_delete", 00:05:35.904 "bdev_zone_block_create", 00:05:35.904 "blobfs_create", 00:05:35.904 "blobfs_detect", 00:05:35.904 "blobfs_set_cache_size", 00:05:35.904 "bdev_aio_delete", 00:05:35.904 "bdev_aio_rescan", 00:05:35.904 "bdev_aio_create", 00:05:35.904 "bdev_ftl_set_property", 00:05:35.904 "bdev_ftl_get_properties", 00:05:35.904 "bdev_ftl_get_stats", 00:05:35.904 "bdev_ftl_unmap", 00:05:35.904 "bdev_ftl_unload", 00:05:35.904 "bdev_ftl_delete", 00:05:35.904 "bdev_ftl_load", 00:05:35.904 "bdev_ftl_create", 00:05:35.904 "bdev_virtio_attach_controller", 00:05:35.904 "bdev_virtio_scsi_get_devices", 00:05:35.904 "bdev_virtio_detach_controller", 00:05:35.904 "bdev_virtio_blk_set_hotplug", 00:05:35.904 "bdev_iscsi_delete", 00:05:35.904 "bdev_iscsi_create", 00:05:35.904 "bdev_iscsi_set_options", 00:05:35.904 "accel_error_inject_error", 00:05:35.904 "ioat_scan_accel_module", 00:05:35.904 "dsa_scan_accel_module", 00:05:35.904 "iaa_scan_accel_module", 00:05:35.904 "keyring_file_remove_key", 00:05:35.904 "keyring_file_add_key", 00:05:35.904 "iscsi_get_histogram", 00:05:35.904 "iscsi_enable_histogram", 00:05:35.904 "iscsi_set_options", 00:05:35.904 "iscsi_get_auth_groups", 00:05:35.904 "iscsi_auth_group_remove_secret", 00:05:35.904 "iscsi_auth_group_add_secret", 00:05:35.904 "iscsi_delete_auth_group", 00:05:35.904 "iscsi_create_auth_group", 00:05:35.904 "iscsi_set_discovery_auth", 00:05:35.904 "iscsi_get_options", 00:05:35.904 "iscsi_target_node_request_logout", 00:05:35.904 "iscsi_target_node_set_redirect", 00:05:35.904 "iscsi_target_node_set_auth", 00:05:35.904 "iscsi_target_node_add_lun", 00:05:35.904 "iscsi_get_stats", 00:05:35.904 "iscsi_get_connections", 00:05:35.904 "iscsi_portal_group_set_auth", 00:05:35.904 "iscsi_start_portal_group", 00:05:35.904 "iscsi_delete_portal_group", 00:05:35.904 "iscsi_create_portal_group", 00:05:35.904 "iscsi_get_portal_groups", 00:05:35.904 "iscsi_delete_target_node", 00:05:35.904 "iscsi_target_node_remove_pg_ig_maps", 00:05:35.904 "iscsi_target_node_add_pg_ig_maps", 00:05:35.904 "iscsi_create_target_node", 00:05:35.904 "iscsi_get_target_nodes", 00:05:35.904 "iscsi_delete_initiator_group", 00:05:35.904 "iscsi_initiator_group_remove_initiators", 00:05:35.904 "iscsi_initiator_group_add_initiators", 00:05:35.904 "iscsi_create_initiator_group", 00:05:35.904 "iscsi_get_initiator_groups", 00:05:35.904 "nvmf_set_crdt", 00:05:35.904 "nvmf_set_config", 00:05:35.904 "nvmf_set_max_subsystems", 00:05:35.904 "nvmf_subsystem_get_listeners", 00:05:35.904 "nvmf_subsystem_get_qpairs", 00:05:35.904 "nvmf_subsystem_get_controllers", 00:05:35.904 "nvmf_get_stats", 00:05:35.904 "nvmf_get_transports", 00:05:35.904 "nvmf_create_transport", 00:05:35.904 "nvmf_get_targets", 00:05:35.904 "nvmf_delete_target", 00:05:35.904 "nvmf_create_target", 00:05:35.904 "nvmf_subsystem_allow_any_host", 00:05:35.904 "nvmf_subsystem_remove_host", 00:05:35.904 "nvmf_subsystem_add_host", 00:05:35.904 "nvmf_ns_remove_host", 00:05:35.904 "nvmf_ns_add_host", 00:05:35.904 "nvmf_subsystem_remove_ns", 00:05:35.904 "nvmf_subsystem_add_ns", 00:05:35.904 "nvmf_subsystem_listener_set_ana_state", 00:05:35.904 "nvmf_discovery_get_referrals", 00:05:35.904 "nvmf_discovery_remove_referral", 00:05:35.904 "nvmf_discovery_add_referral", 00:05:35.904 "nvmf_subsystem_remove_listener", 00:05:35.904 "nvmf_subsystem_add_listener", 00:05:35.904 "nvmf_delete_subsystem", 00:05:35.904 "nvmf_create_subsystem", 00:05:35.904 "nvmf_get_subsystems", 00:05:35.904 "env_dpdk_get_mem_stats", 00:05:35.904 "nbd_get_disks", 00:05:35.904 "nbd_stop_disk", 00:05:35.904 "nbd_start_disk", 00:05:35.904 "ublk_recover_disk", 00:05:35.904 "ublk_get_disks", 00:05:35.904 "ublk_stop_disk", 00:05:35.904 "ublk_start_disk", 00:05:35.904 "ublk_destroy_target", 00:05:35.904 "ublk_create_target", 00:05:35.904 "virtio_blk_create_transport", 00:05:35.904 "virtio_blk_get_transports", 00:05:35.904 "vhost_controller_set_coalescing", 00:05:35.904 "vhost_get_controllers", 00:05:35.904 "vhost_delete_controller", 00:05:35.904 "vhost_create_blk_controller", 00:05:35.904 "vhost_scsi_controller_remove_target", 00:05:35.904 "vhost_scsi_controller_add_target", 00:05:35.904 "vhost_start_scsi_controller", 00:05:35.904 "vhost_create_scsi_controller", 00:05:35.904 "thread_set_cpumask", 00:05:35.904 "framework_get_scheduler", 00:05:35.904 "framework_set_scheduler", 00:05:35.904 "framework_get_reactors", 00:05:35.904 "thread_get_io_channels", 00:05:35.904 "thread_get_pollers", 00:05:35.904 "thread_get_stats", 00:05:35.904 "framework_monitor_context_switch", 00:05:35.904 "spdk_kill_instance", 00:05:35.904 "log_enable_timestamps", 00:05:35.904 "log_get_flags", 00:05:35.904 "log_clear_flag", 00:05:35.904 "log_set_flag", 00:05:35.904 "log_get_level", 00:05:35.904 "log_set_level", 00:05:35.904 "log_get_print_level", 00:05:35.904 "log_set_print_level", 00:05:35.904 "framework_enable_cpumask_locks", 00:05:35.904 "framework_disable_cpumask_locks", 00:05:35.904 "framework_wait_init", 00:05:35.904 "framework_start_init", 00:05:35.904 "scsi_get_devices", 00:05:35.905 "bdev_get_histogram", 00:05:35.905 "bdev_enable_histogram", 00:05:35.905 "bdev_set_qos_limit", 00:05:35.905 "bdev_set_qd_sampling_period", 00:05:35.905 "bdev_get_bdevs", 00:05:35.905 "bdev_reset_iostat", 00:05:35.905 "bdev_get_iostat", 00:05:35.905 "bdev_examine", 00:05:35.905 "bdev_wait_for_examine", 00:05:35.905 "bdev_set_options", 00:05:35.905 "notify_get_notifications", 00:05:35.905 "notify_get_types", 00:05:35.905 "accel_get_stats", 00:05:35.905 "accel_set_options", 00:05:35.905 "accel_set_driver", 00:05:35.905 "accel_crypto_key_destroy", 00:05:35.905 "accel_crypto_keys_get", 00:05:35.905 "accel_crypto_key_create", 00:05:35.905 "accel_assign_opc", 00:05:35.905 "accel_get_module_info", 00:05:35.905 "accel_get_opc_assignments", 00:05:35.905 "vmd_rescan", 00:05:35.905 "vmd_remove_device", 00:05:35.905 "vmd_enable", 00:05:35.905 "sock_set_default_impl", 00:05:35.905 "sock_impl_set_options", 00:05:35.905 "sock_impl_get_options", 00:05:35.905 "iobuf_get_stats", 00:05:35.905 "iobuf_set_options", 00:05:35.905 "framework_get_pci_devices", 00:05:35.905 "framework_get_config", 00:05:35.905 "framework_get_subsystems", 00:05:35.905 "trace_get_info", 00:05:35.905 "trace_get_tpoint_group_mask", 00:05:35.905 "trace_disable_tpoint_group", 00:05:35.905 "trace_enable_tpoint_group", 00:05:35.905 "trace_clear_tpoint_mask", 00:05:35.905 "trace_set_tpoint_mask", 00:05:35.905 "keyring_get_keys", 00:05:35.905 "spdk_get_version", 00:05:35.905 "rpc_get_methods" 00:05:35.905 ] 00:05:36.164 19:12:22 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:36.164 19:12:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:36.164 19:12:22 -- common/autotest_common.sh@10 -- # set +x 00:05:36.164 19:12:22 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:36.164 19:12:22 -- spdkcli/tcp.sh@38 -- # killprocess 2888844 00:05:36.164 19:12:22 -- common/autotest_common.sh@936 -- # '[' -z 2888844 ']' 00:05:36.164 19:12:22 -- common/autotest_common.sh@940 -- # kill -0 2888844 00:05:36.164 19:12:22 -- common/autotest_common.sh@941 -- # uname 00:05:36.164 19:12:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:36.164 19:12:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2888844 00:05:36.164 19:12:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:36.164 19:12:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:36.164 19:12:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2888844' 00:05:36.164 killing process with pid 2888844 00:05:36.164 19:12:23 -- common/autotest_common.sh@955 -- # kill 2888844 00:05:36.164 19:12:23 -- common/autotest_common.sh@960 -- # wait 2888844 00:05:36.422 00:05:36.422 real 0m1.623s 00:05:36.422 user 0m2.912s 00:05:36.422 sys 0m0.508s 00:05:36.422 19:12:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:36.422 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:05:36.422 ************************************ 00:05:36.422 END TEST spdkcli_tcp 00:05:36.422 ************************************ 00:05:36.422 19:12:23 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.681 19:12:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.681 19:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.681 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:05:36.681 ************************************ 00:05:36.681 START TEST dpdk_mem_utility 00:05:36.681 ************************************ 00:05:36.681 19:12:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.681 * Looking for test storage... 00:05:36.681 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:05:36.681 19:12:23 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:36.681 19:12:23 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2889110 00:05:36.681 19:12:23 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2889110 00:05:36.681 19:12:23 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:36.681 19:12:23 -- common/autotest_common.sh@817 -- # '[' -z 2889110 ']' 00:05:36.681 19:12:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:36.681 19:12:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:36.681 19:12:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:36.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:36.681 19:12:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:36.681 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:05:36.939 [2024-04-24 19:12:23.750251] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:36.939 [2024-04-24 19:12:23.750310] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2889110 ] 00:05:36.939 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.939 [2024-04-24 19:12:23.823962] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.939 [2024-04-24 19:12:23.912344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.873 19:12:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:37.873 19:12:24 -- common/autotest_common.sh@850 -- # return 0 00:05:37.873 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:37.873 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:37.873 19:12:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:37.873 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:05:37.873 { 00:05:37.873 "filename": "/tmp/spdk_mem_dump.txt" 00:05:37.873 } 00:05:37.873 19:12:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:37.873 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:37.873 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:37.873 1 heaps totaling size 814.000000 MiB 00:05:37.873 size: 814.000000 MiB heap id: 0 00:05:37.873 end heaps---------- 00:05:37.873 8 mempools totaling size 598.116089 MiB 00:05:37.873 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:37.873 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:37.873 size: 84.521057 MiB name: bdev_io_2889110 00:05:37.873 size: 51.011292 MiB name: evtpool_2889110 00:05:37.873 size: 50.003479 MiB name: msgpool_2889110 00:05:37.873 size: 21.763794 MiB name: PDU_Pool 00:05:37.873 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:37.873 size: 0.026123 MiB name: Session_Pool 00:05:37.873 end mempools------- 00:05:37.873 6 memzones totaling size 4.142822 MiB 00:05:37.873 size: 1.000366 MiB name: RG_ring_0_2889110 00:05:37.873 size: 1.000366 MiB name: RG_ring_1_2889110 00:05:37.873 size: 1.000366 MiB name: RG_ring_4_2889110 00:05:37.873 size: 1.000366 MiB name: RG_ring_5_2889110 00:05:37.873 size: 0.125366 MiB name: RG_ring_2_2889110 00:05:37.873 size: 0.015991 MiB name: RG_ring_3_2889110 00:05:37.873 end memzones------- 00:05:37.873 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:37.873 heap id: 0 total size: 814.000000 MiB number of busy elements: 42 number of free elements: 15 00:05:37.873 list of free elements. size: 12.517212 MiB 00:05:37.873 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:37.873 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:37.873 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:37.873 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:37.873 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:37.873 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:37.873 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:37.873 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:37.873 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:37.873 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:37.873 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:37.873 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:37.873 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:37.873 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:37.873 element at address: 0x200003a00000 with size: 0.353394 MiB 00:05:37.873 list of standard malloc elements. size: 199.220215 MiB 00:05:37.873 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:37.873 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:37.873 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:37.873 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:37.874 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:37.874 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:37.874 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:37.874 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:37.874 element at address: 0x200003aff280 with size: 0.002136 MiB 00:05:37.874 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:37.874 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003a5a780 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003adaa40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003adac40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003adef00 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003aff1c0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:37.874 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:37.874 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:37.874 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:37.874 list of memzone associated elements. size: 602.262573 MiB 00:05:37.874 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:37.874 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:37.874 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:37.874 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:37.874 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:37.874 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2889110_0 00:05:37.874 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:37.874 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2889110_0 00:05:37.874 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:37.874 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2889110_0 00:05:37.874 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:37.874 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:37.874 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:37.874 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:37.874 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:37.874 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2889110 00:05:37.874 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:37.874 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2889110 00:05:37.874 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:37.874 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2889110 00:05:37.874 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:37.874 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:37.874 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:37.874 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:37.874 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:37.874 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:37.874 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:37.874 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:37.874 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:37.874 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2889110 00:05:37.874 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:37.874 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2889110 00:05:37.874 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:37.874 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2889110 00:05:37.874 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:37.874 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2889110 00:05:37.874 element at address: 0x200003a5a840 with size: 0.500488 MiB 00:05:37.874 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2889110 00:05:37.874 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:37.874 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:37.874 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:37.874 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:37.874 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:37.874 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:37.874 element at address: 0x200003adefc0 with size: 0.125488 MiB 00:05:37.874 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2889110 00:05:37.874 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:37.874 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:37.874 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:37.874 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:37.874 element at address: 0x200003adad00 with size: 0.016113 MiB 00:05:37.874 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2889110 00:05:37.874 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:37.874 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:37.874 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:37.874 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2889110 00:05:37.874 element at address: 0x200003adab00 with size: 0.000305 MiB 00:05:37.874 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2889110 00:05:37.874 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:37.874 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:37.874 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:37.874 19:12:24 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2889110 00:05:37.874 19:12:24 -- common/autotest_common.sh@936 -- # '[' -z 2889110 ']' 00:05:37.874 19:12:24 -- common/autotest_common.sh@940 -- # kill -0 2889110 00:05:37.874 19:12:24 -- common/autotest_common.sh@941 -- # uname 00:05:37.874 19:12:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:37.874 19:12:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2889110 00:05:37.874 19:12:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:37.874 19:12:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:37.874 19:12:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2889110' 00:05:37.874 killing process with pid 2889110 00:05:37.874 19:12:24 -- common/autotest_common.sh@955 -- # kill 2889110 00:05:37.874 19:12:24 -- common/autotest_common.sh@960 -- # wait 2889110 00:05:38.133 00:05:38.133 real 0m1.517s 00:05:38.133 user 0m1.546s 00:05:38.133 sys 0m0.475s 00:05:38.133 19:12:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.133 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:05:38.133 ************************************ 00:05:38.133 END TEST dpdk_mem_utility 00:05:38.133 ************************************ 00:05:38.133 19:12:25 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:38.133 19:12:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.133 19:12:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.133 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:05:38.392 ************************************ 00:05:38.392 START TEST event 00:05:38.392 ************************************ 00:05:38.392 19:12:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:38.651 * Looking for test storage... 00:05:38.651 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:38.651 19:12:25 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:38.651 19:12:25 -- bdev/nbd_common.sh@6 -- # set -e 00:05:38.651 19:12:25 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.651 19:12:25 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:38.651 19:12:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.651 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:05:38.651 ************************************ 00:05:38.651 START TEST event_perf 00:05:38.651 ************************************ 00:05:38.651 19:12:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.651 Running I/O for 1 seconds...[2024-04-24 19:12:25.595225] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:38.651 [2024-04-24 19:12:25.595297] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2889533 ] 00:05:38.651 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.651 [2024-04-24 19:12:25.670357] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:38.909 [2024-04-24 19:12:25.754385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.909 [2024-04-24 19:12:25.754472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.909 [2024-04-24 19:12:25.754559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.909 [2024-04-24 19:12:25.754548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:39.844 Running I/O for 1 seconds... 00:05:39.844 lcore 0: 201608 00:05:39.844 lcore 1: 201609 00:05:39.844 lcore 2: 201608 00:05:39.844 lcore 3: 201608 00:05:39.844 done. 00:05:39.844 00:05:39.844 real 0m1.285s 00:05:39.844 user 0m4.189s 00:05:39.844 sys 0m0.091s 00:05:39.844 19:12:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.844 19:12:26 -- common/autotest_common.sh@10 -- # set +x 00:05:39.844 ************************************ 00:05:39.844 END TEST event_perf 00:05:39.844 ************************************ 00:05:40.103 19:12:26 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:40.103 19:12:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:40.103 19:12:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.103 19:12:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.103 ************************************ 00:05:40.103 START TEST event_reactor 00:05:40.103 ************************************ 00:05:40.103 19:12:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:40.103 [2024-04-24 19:12:27.089075] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:40.103 [2024-04-24 19:12:27.089156] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2889753 ] 00:05:40.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.362 [2024-04-24 19:12:27.164402] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.362 [2024-04-24 19:12:27.248598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.738 test_start 00:05:41.738 oneshot 00:05:41.738 tick 100 00:05:41.738 tick 100 00:05:41.738 tick 250 00:05:41.738 tick 100 00:05:41.738 tick 100 00:05:41.738 tick 250 00:05:41.738 tick 100 00:05:41.738 tick 500 00:05:41.738 tick 100 00:05:41.738 tick 100 00:05:41.738 tick 250 00:05:41.738 tick 100 00:05:41.738 tick 100 00:05:41.738 test_end 00:05:41.738 00:05:41.738 real 0m1.279s 00:05:41.738 user 0m1.171s 00:05:41.738 sys 0m0.103s 00:05:41.738 19:12:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.738 19:12:28 -- common/autotest_common.sh@10 -- # set +x 00:05:41.738 ************************************ 00:05:41.738 END TEST event_reactor 00:05:41.738 ************************************ 00:05:41.738 19:12:28 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.738 19:12:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:41.738 19:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.738 19:12:28 -- common/autotest_common.sh@10 -- # set +x 00:05:41.738 ************************************ 00:05:41.738 START TEST event_reactor_perf 00:05:41.738 ************************************ 00:05:41.738 19:12:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:41.738 [2024-04-24 19:12:28.573259] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:41.738 [2024-04-24 19:12:28.573344] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2889957 ] 00:05:41.738 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.738 [2024-04-24 19:12:28.647887] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.738 [2024-04-24 19:12:28.732896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.115 test_start 00:05:43.115 test_end 00:05:43.115 Performance: 512847 events per second 00:05:43.115 00:05:43.115 real 0m1.282s 00:05:43.116 user 0m1.179s 00:05:43.116 sys 0m0.098s 00:05:43.116 19:12:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:43.116 19:12:29 -- common/autotest_common.sh@10 -- # set +x 00:05:43.116 ************************************ 00:05:43.116 END TEST event_reactor_perf 00:05:43.116 ************************************ 00:05:43.116 19:12:29 -- event/event.sh@49 -- # uname -s 00:05:43.116 19:12:29 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:43.116 19:12:29 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:43.116 19:12:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:43.116 19:12:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.116 19:12:29 -- common/autotest_common.sh@10 -- # set +x 00:05:43.116 ************************************ 00:05:43.116 START TEST event_scheduler 00:05:43.116 ************************************ 00:05:43.116 19:12:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:43.374 * Looking for test storage... 00:05:43.374 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:05:43.374 19:12:30 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:43.374 19:12:30 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:43.374 19:12:30 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2890200 00:05:43.374 19:12:30 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:43.374 19:12:30 -- scheduler/scheduler.sh@37 -- # waitforlisten 2890200 00:05:43.375 19:12:30 -- common/autotest_common.sh@817 -- # '[' -z 2890200 ']' 00:05:43.375 19:12:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:43.375 19:12:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:43.375 19:12:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:43.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:43.375 19:12:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:43.375 19:12:30 -- common/autotest_common.sh@10 -- # set +x 00:05:43.375 [2024-04-24 19:12:30.190532] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:43.375 [2024-04-24 19:12:30.190595] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2890200 ] 00:05:43.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.375 [2024-04-24 19:12:30.259561] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:43.375 [2024-04-24 19:12:30.352875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.375 [2024-04-24 19:12:30.352951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:43.375 [2024-04-24 19:12:30.353028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:43.375 [2024-04-24 19:12:30.353030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:44.009 19:12:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:44.009 19:12:31 -- common/autotest_common.sh@850 -- # return 0 00:05:44.009 19:12:31 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:44.268 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.268 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.268 POWER: Env isn't set yet! 00:05:44.268 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:44.268 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:44.268 POWER: Cannot set governor of lcore 0 to userspace 00:05:44.268 POWER: Attempting to initialise PSTAT power management... 00:05:44.268 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:44.268 POWER: Initialized successfully for lcore 0 power management 00:05:44.268 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:44.268 POWER: Initialized successfully for lcore 1 power management 00:05:44.268 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:44.268 POWER: Initialized successfully for lcore 2 power management 00:05:44.268 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:44.268 POWER: Initialized successfully for lcore 3 power management 00:05:44.268 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.268 19:12:31 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:44.268 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.268 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.268 [2024-04-24 19:12:31.138767] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:44.268 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.268 19:12:31 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:44.268 19:12:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.268 19:12:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.268 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.268 ************************************ 00:05:44.268 START TEST scheduler_create_thread 00:05:44.268 ************************************ 00:05:44.526 19:12:31 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 2 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 3 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 4 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 5 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 6 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 7 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 8 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 9 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 10 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:44.526 19:12:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:44.526 19:12:31 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:44.526 19:12:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:44.526 19:12:31 -- common/autotest_common.sh@10 -- # set +x 00:05:45.461 19:12:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:45.461 19:12:32 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:45.461 19:12:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:45.461 19:12:32 -- common/autotest_common.sh@10 -- # set +x 00:05:46.837 19:12:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:46.837 19:12:33 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:46.837 19:12:33 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:46.837 19:12:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:46.837 19:12:33 -- common/autotest_common.sh@10 -- # set +x 00:05:47.829 19:12:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:47.829 00:05:47.829 real 0m3.483s 00:05:47.829 user 0m0.021s 00:05:47.829 sys 0m0.008s 00:05:47.829 19:12:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.829 19:12:34 -- common/autotest_common.sh@10 -- # set +x 00:05:47.829 ************************************ 00:05:47.829 END TEST scheduler_create_thread 00:05:47.830 ************************************ 00:05:47.830 19:12:34 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:47.830 19:12:34 -- scheduler/scheduler.sh@46 -- # killprocess 2890200 00:05:47.830 19:12:34 -- common/autotest_common.sh@936 -- # '[' -z 2890200 ']' 00:05:47.830 19:12:34 -- common/autotest_common.sh@940 -- # kill -0 2890200 00:05:47.830 19:12:34 -- common/autotest_common.sh@941 -- # uname 00:05:47.830 19:12:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.830 19:12:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2890200 00:05:48.088 19:12:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:48.088 19:12:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:48.088 19:12:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2890200' 00:05:48.088 killing process with pid 2890200 00:05:48.088 19:12:34 -- common/autotest_common.sh@955 -- # kill 2890200 00:05:48.088 19:12:34 -- common/autotest_common.sh@960 -- # wait 2890200 00:05:48.347 [2024-04-24 19:12:35.252058] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:48.347 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:48.347 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:48.347 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:48.347 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:48.347 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:48.347 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:48.347 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:48.347 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:48.606 00:05:48.606 real 0m5.431s 00:05:48.606 user 0m8.851s 00:05:48.606 sys 0m0.520s 00:05:48.606 19:12:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.606 19:12:35 -- common/autotest_common.sh@10 -- # set +x 00:05:48.606 ************************************ 00:05:48.606 END TEST event_scheduler 00:05:48.606 ************************************ 00:05:48.606 19:12:35 -- event/event.sh@51 -- # modprobe -n nbd 00:05:48.606 19:12:35 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:48.606 19:12:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.606 19:12:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.606 19:12:35 -- common/autotest_common.sh@10 -- # set +x 00:05:48.865 ************************************ 00:05:48.865 START TEST app_repeat 00:05:48.865 ************************************ 00:05:48.865 19:12:35 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:05:48.865 19:12:35 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.865 19:12:35 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.865 19:12:35 -- event/event.sh@13 -- # local nbd_list 00:05:48.865 19:12:35 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:48.865 19:12:35 -- event/event.sh@14 -- # local bdev_list 00:05:48.865 19:12:35 -- event/event.sh@15 -- # local repeat_times=4 00:05:48.865 19:12:35 -- event/event.sh@17 -- # modprobe nbd 00:05:48.865 19:12:35 -- event/event.sh@19 -- # repeat_pid=2890997 00:05:48.865 19:12:35 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:48.865 19:12:35 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:48.865 19:12:35 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2890997' 00:05:48.865 Process app_repeat pid: 2890997 00:05:48.865 19:12:35 -- event/event.sh@23 -- # for i in {0..2} 00:05:48.865 19:12:35 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:48.865 spdk_app_start Round 0 00:05:48.865 19:12:35 -- event/event.sh@25 -- # waitforlisten 2890997 /var/tmp/spdk-nbd.sock 00:05:48.865 19:12:35 -- common/autotest_common.sh@817 -- # '[' -z 2890997 ']' 00:05:48.865 19:12:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:48.865 19:12:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:48.865 19:12:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:48.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:48.865 19:12:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:48.865 19:12:35 -- common/autotest_common.sh@10 -- # set +x 00:05:48.865 [2024-04-24 19:12:35.728634] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:05:48.865 [2024-04-24 19:12:35.728697] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2890997 ] 00:05:48.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.865 [2024-04-24 19:12:35.801437] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:49.328 [2024-04-24 19:12:35.888772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:49.328 [2024-04-24 19:12:35.888775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.587 19:12:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:49.587 19:12:36 -- common/autotest_common.sh@850 -- # return 0 00:05:49.587 19:12:36 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:49.845 Malloc0 00:05:49.845 19:12:36 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:50.103 Malloc1 00:05:50.103 19:12:36 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@12 -- # local i 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:50.103 19:12:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:50.103 /dev/nbd0 00:05:50.103 19:12:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:50.361 19:12:37 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:50.361 19:12:37 -- common/autotest_common.sh@855 -- # local i 00:05:50.361 19:12:37 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:50.361 19:12:37 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:50.361 19:12:37 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:50.361 19:12:37 -- common/autotest_common.sh@859 -- # break 00:05:50.361 19:12:37 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:50.361 19:12:37 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:50.361 19:12:37 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:50.361 1+0 records in 00:05:50.361 1+0 records out 00:05:50.361 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000238627 s, 17.2 MB/s 00:05:50.361 19:12:37 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:50.361 19:12:37 -- common/autotest_common.sh@872 -- # size=4096 00:05:50.361 19:12:37 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:50.361 19:12:37 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:50.361 19:12:37 -- common/autotest_common.sh@875 -- # return 0 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:50.361 /dev/nbd1 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:50.361 19:12:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:50.361 19:12:37 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:50.361 19:12:37 -- common/autotest_common.sh@855 -- # local i 00:05:50.361 19:12:37 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:50.362 19:12:37 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:50.362 19:12:37 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:50.362 19:12:37 -- common/autotest_common.sh@859 -- # break 00:05:50.362 19:12:37 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:50.362 19:12:37 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:50.362 19:12:37 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:50.362 1+0 records in 00:05:50.362 1+0 records out 00:05:50.362 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000144988 s, 28.3 MB/s 00:05:50.362 19:12:37 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:50.362 19:12:37 -- common/autotest_common.sh@872 -- # size=4096 00:05:50.362 19:12:37 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:50.362 19:12:37 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:50.362 19:12:37 -- common/autotest_common.sh@875 -- # return 0 00:05:50.362 19:12:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:50.362 19:12:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:50.362 19:12:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:50.362 19:12:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.362 19:12:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:50.620 19:12:37 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:50.620 { 00:05:50.620 "nbd_device": "/dev/nbd0", 00:05:50.620 "bdev_name": "Malloc0" 00:05:50.620 }, 00:05:50.620 { 00:05:50.620 "nbd_device": "/dev/nbd1", 00:05:50.620 "bdev_name": "Malloc1" 00:05:50.620 } 00:05:50.620 ]' 00:05:50.620 19:12:37 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:50.620 { 00:05:50.621 "nbd_device": "/dev/nbd0", 00:05:50.621 "bdev_name": "Malloc0" 00:05:50.621 }, 00:05:50.621 { 00:05:50.621 "nbd_device": "/dev/nbd1", 00:05:50.621 "bdev_name": "Malloc1" 00:05:50.621 } 00:05:50.621 ]' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:50.621 /dev/nbd1' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:50.621 /dev/nbd1' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@65 -- # count=2 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@95 -- # count=2 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:50.621 256+0 records in 00:05:50.621 256+0 records out 00:05:50.621 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856623 s, 122 MB/s 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:50.621 256+0 records in 00:05:50.621 256+0 records out 00:05:50.621 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020138 s, 52.1 MB/s 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:50.621 19:12:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:50.880 256+0 records in 00:05:50.880 256+0 records out 00:05:50.880 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021665 s, 48.4 MB/s 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@51 -- # local i 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@41 -- # break 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@45 -- # return 0 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:50.880 19:12:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@41 -- # break 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@45 -- # return 0 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:51.139 19:12:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@65 -- # true 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@65 -- # count=0 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@104 -- # count=0 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:51.400 19:12:38 -- bdev/nbd_common.sh@109 -- # return 0 00:05:51.400 19:12:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:51.659 19:12:38 -- event/event.sh@35 -- # sleep 3 00:05:51.920 [2024-04-24 19:12:38.729411] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:51.920 [2024-04-24 19:12:38.809623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.920 [2024-04-24 19:12:38.809625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.920 [2024-04-24 19:12:38.858002] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:51.920 [2024-04-24 19:12:38.858049] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:55.205 19:12:41 -- event/event.sh@23 -- # for i in {0..2} 00:05:55.205 19:12:41 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:55.205 spdk_app_start Round 1 00:05:55.205 19:12:41 -- event/event.sh@25 -- # waitforlisten 2890997 /var/tmp/spdk-nbd.sock 00:05:55.205 19:12:41 -- common/autotest_common.sh@817 -- # '[' -z 2890997 ']' 00:05:55.205 19:12:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:55.205 19:12:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:55.205 19:12:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:55.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:55.205 19:12:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:55.205 19:12:41 -- common/autotest_common.sh@10 -- # set +x 00:05:55.205 19:12:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:55.205 19:12:41 -- common/autotest_common.sh@850 -- # return 0 00:05:55.205 19:12:41 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:55.205 Malloc0 00:05:55.205 19:12:41 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:55.205 Malloc1 00:05:55.205 19:12:42 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@12 -- # local i 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:55.205 19:12:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:55.205 /dev/nbd0 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:55.464 19:12:42 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:55.464 19:12:42 -- common/autotest_common.sh@855 -- # local i 00:05:55.464 19:12:42 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:55.464 19:12:42 -- common/autotest_common.sh@859 -- # break 00:05:55.464 19:12:42 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:55.464 1+0 records in 00:05:55.464 1+0 records out 00:05:55.464 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000245107 s, 16.7 MB/s 00:05:55.464 19:12:42 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:55.464 19:12:42 -- common/autotest_common.sh@872 -- # size=4096 00:05:55.464 19:12:42 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:55.464 19:12:42 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:55.464 19:12:42 -- common/autotest_common.sh@875 -- # return 0 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:55.464 /dev/nbd1 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:55.464 19:12:42 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:55.464 19:12:42 -- common/autotest_common.sh@855 -- # local i 00:05:55.464 19:12:42 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:55.464 19:12:42 -- common/autotest_common.sh@859 -- # break 00:05:55.464 19:12:42 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:55.464 19:12:42 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:55.464 1+0 records in 00:05:55.464 1+0 records out 00:05:55.464 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000244941 s, 16.7 MB/s 00:05:55.464 19:12:42 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:55.464 19:12:42 -- common/autotest_common.sh@872 -- # size=4096 00:05:55.464 19:12:42 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:55.464 19:12:42 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:55.464 19:12:42 -- common/autotest_common.sh@875 -- # return 0 00:05:55.464 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:55.722 { 00:05:55.722 "nbd_device": "/dev/nbd0", 00:05:55.722 "bdev_name": "Malloc0" 00:05:55.722 }, 00:05:55.722 { 00:05:55.722 "nbd_device": "/dev/nbd1", 00:05:55.722 "bdev_name": "Malloc1" 00:05:55.722 } 00:05:55.722 ]' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:55.722 { 00:05:55.722 "nbd_device": "/dev/nbd0", 00:05:55.722 "bdev_name": "Malloc0" 00:05:55.722 }, 00:05:55.722 { 00:05:55.722 "nbd_device": "/dev/nbd1", 00:05:55.722 "bdev_name": "Malloc1" 00:05:55.722 } 00:05:55.722 ]' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:55.722 /dev/nbd1' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:55.722 /dev/nbd1' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@65 -- # count=2 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@95 -- # count=2 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:55.722 256+0 records in 00:05:55.722 256+0 records out 00:05:55.722 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081424 s, 129 MB/s 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.722 19:12:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:55.979 256+0 records in 00:05:55.979 256+0 records out 00:05:55.979 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01711 s, 61.3 MB/s 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:55.979 256+0 records in 00:05:55.979 256+0 records out 00:05:55.979 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227668 s, 46.1 MB/s 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.979 19:12:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@51 -- # local i 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:55.980 19:12:42 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@41 -- # break 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@45 -- # return 0 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@41 -- # break 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@45 -- # return 0 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:56.237 19:12:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@65 -- # true 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@65 -- # count=0 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@104 -- # count=0 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:56.494 19:12:43 -- bdev/nbd_common.sh@109 -- # return 0 00:05:56.494 19:12:43 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:56.758 19:12:43 -- event/event.sh@35 -- # sleep 3 00:05:57.016 [2024-04-24 19:12:43.850210] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:57.016 [2024-04-24 19:12:43.928231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.017 [2024-04-24 19:12:43.928234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.017 [2024-04-24 19:12:43.970598] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:57.017 [2024-04-24 19:12:43.970643] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:00.296 19:12:46 -- event/event.sh@23 -- # for i in {0..2} 00:06:00.296 19:12:46 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:00.296 spdk_app_start Round 2 00:06:00.296 19:12:46 -- event/event.sh@25 -- # waitforlisten 2890997 /var/tmp/spdk-nbd.sock 00:06:00.296 19:12:46 -- common/autotest_common.sh@817 -- # '[' -z 2890997 ']' 00:06:00.296 19:12:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:00.296 19:12:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:00.296 19:12:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:00.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:00.296 19:12:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:00.296 19:12:46 -- common/autotest_common.sh@10 -- # set +x 00:06:00.296 19:12:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:00.296 19:12:46 -- common/autotest_common.sh@850 -- # return 0 00:06:00.296 19:12:46 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:00.296 Malloc0 00:06:00.296 19:12:46 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:00.296 Malloc1 00:06:00.296 19:12:47 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@12 -- # local i 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.296 19:12:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:00.555 /dev/nbd0 00:06:00.555 19:12:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:00.555 19:12:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:00.555 19:12:47 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:00.555 19:12:47 -- common/autotest_common.sh@855 -- # local i 00:06:00.555 19:12:47 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:00.555 19:12:47 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:00.555 19:12:47 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:00.555 19:12:47 -- common/autotest_common.sh@859 -- # break 00:06:00.555 19:12:47 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:00.555 19:12:47 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:00.555 19:12:47 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:00.555 1+0 records in 00:06:00.555 1+0 records out 00:06:00.555 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000251611 s, 16.3 MB/s 00:06:00.555 19:12:47 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:00.555 19:12:47 -- common/autotest_common.sh@872 -- # size=4096 00:06:00.555 19:12:47 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:00.555 19:12:47 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:00.555 19:12:47 -- common/autotest_common.sh@875 -- # return 0 00:06:00.555 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:00.555 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.555 19:12:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:00.555 /dev/nbd1 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:00.813 19:12:47 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:00.813 19:12:47 -- common/autotest_common.sh@855 -- # local i 00:06:00.813 19:12:47 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:00.813 19:12:47 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:00.813 19:12:47 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:00.813 19:12:47 -- common/autotest_common.sh@859 -- # break 00:06:00.813 19:12:47 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:00.813 19:12:47 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:00.813 19:12:47 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:00.813 1+0 records in 00:06:00.813 1+0 records out 00:06:00.813 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000242921 s, 16.9 MB/s 00:06:00.813 19:12:47 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:00.813 19:12:47 -- common/autotest_common.sh@872 -- # size=4096 00:06:00.813 19:12:47 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:00.813 19:12:47 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:00.813 19:12:47 -- common/autotest_common.sh@875 -- # return 0 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:00.813 { 00:06:00.813 "nbd_device": "/dev/nbd0", 00:06:00.813 "bdev_name": "Malloc0" 00:06:00.813 }, 00:06:00.813 { 00:06:00.813 "nbd_device": "/dev/nbd1", 00:06:00.813 "bdev_name": "Malloc1" 00:06:00.813 } 00:06:00.813 ]' 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:00.813 { 00:06:00.813 "nbd_device": "/dev/nbd0", 00:06:00.813 "bdev_name": "Malloc0" 00:06:00.813 }, 00:06:00.813 { 00:06:00.813 "nbd_device": "/dev/nbd1", 00:06:00.813 "bdev_name": "Malloc1" 00:06:00.813 } 00:06:00.813 ]' 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:00.813 /dev/nbd1' 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:00.813 /dev/nbd1' 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@65 -- # count=2 00:06:00.813 19:12:47 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@95 -- # count=2 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:01.071 256+0 records in 00:06:01.071 256+0 records out 00:06:01.071 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105656 s, 99.2 MB/s 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:01.071 256+0 records in 00:06:01.071 256+0 records out 00:06:01.071 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203207 s, 51.6 MB/s 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:01.071 256+0 records in 00:06:01.071 256+0 records out 00:06:01.071 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195636 s, 53.6 MB/s 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@51 -- # local i 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:01.071 19:12:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@41 -- # break 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@45 -- # return 0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@41 -- # break 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@45 -- # return 0 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:01.329 19:12:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@65 -- # true 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@65 -- # count=0 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@104 -- # count=0 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:01.587 19:12:48 -- bdev/nbd_common.sh@109 -- # return 0 00:06:01.587 19:12:48 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:01.845 19:12:48 -- event/event.sh@35 -- # sleep 3 00:06:02.102 [2024-04-24 19:12:48.969411] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:02.102 [2024-04-24 19:12:49.049124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.102 [2024-04-24 19:12:49.049125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.102 [2024-04-24 19:12:49.098216] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:02.102 [2024-04-24 19:12:49.098264] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:05.380 19:12:51 -- event/event.sh@38 -- # waitforlisten 2890997 /var/tmp/spdk-nbd.sock 00:06:05.380 19:12:51 -- common/autotest_common.sh@817 -- # '[' -z 2890997 ']' 00:06:05.380 19:12:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:05.380 19:12:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:05.380 19:12:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:05.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:05.380 19:12:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:05.380 19:12:51 -- common/autotest_common.sh@10 -- # set +x 00:06:05.380 19:12:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:05.380 19:12:51 -- common/autotest_common.sh@850 -- # return 0 00:06:05.380 19:12:51 -- event/event.sh@39 -- # killprocess 2890997 00:06:05.380 19:12:51 -- common/autotest_common.sh@936 -- # '[' -z 2890997 ']' 00:06:05.380 19:12:51 -- common/autotest_common.sh@940 -- # kill -0 2890997 00:06:05.380 19:12:51 -- common/autotest_common.sh@941 -- # uname 00:06:05.380 19:12:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:05.380 19:12:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2890997 00:06:05.380 19:12:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:05.380 19:12:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:05.380 19:12:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2890997' 00:06:05.380 killing process with pid 2890997 00:06:05.380 19:12:51 -- common/autotest_common.sh@955 -- # kill 2890997 00:06:05.380 19:12:51 -- common/autotest_common.sh@960 -- # wait 2890997 00:06:05.380 spdk_app_start is called in Round 0. 00:06:05.380 Shutdown signal received, stop current app iteration 00:06:05.380 Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 reinitialization... 00:06:05.380 spdk_app_start is called in Round 1. 00:06:05.380 Shutdown signal received, stop current app iteration 00:06:05.380 Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 reinitialization... 00:06:05.380 spdk_app_start is called in Round 2. 00:06:05.380 Shutdown signal received, stop current app iteration 00:06:05.380 Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 reinitialization... 00:06:05.380 spdk_app_start is called in Round 3. 00:06:05.380 Shutdown signal received, stop current app iteration 00:06:05.380 19:12:52 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:05.380 19:12:52 -- event/event.sh@42 -- # return 0 00:06:05.380 00:06:05.380 real 0m16.499s 00:06:05.380 user 0m34.869s 00:06:05.380 sys 0m3.094s 00:06:05.380 19:12:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:05.380 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:06:05.380 ************************************ 00:06:05.380 END TEST app_repeat 00:06:05.380 ************************************ 00:06:05.380 19:12:52 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:05.380 19:12:52 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:05.380 19:12:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.380 19:12:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.380 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:06:05.638 ************************************ 00:06:05.638 START TEST cpu_locks 00:06:05.638 ************************************ 00:06:05.638 19:12:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:05.638 * Looking for test storage... 00:06:05.638 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:06:05.638 19:12:52 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:05.638 19:12:52 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:05.638 19:12:52 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:05.638 19:12:52 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:05.638 19:12:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.638 19:12:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.638 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:06:05.638 ************************************ 00:06:05.638 START TEST default_locks 00:06:05.638 ************************************ 00:06:05.638 19:12:52 -- common/autotest_common.sh@1111 -- # default_locks 00:06:05.638 19:12:52 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2893592 00:06:05.638 19:12:52 -- event/cpu_locks.sh@47 -- # waitforlisten 2893592 00:06:05.638 19:12:52 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:05.638 19:12:52 -- common/autotest_common.sh@817 -- # '[' -z 2893592 ']' 00:06:05.638 19:12:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.638 19:12:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:05.638 19:12:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.638 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.638 19:12:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:05.638 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:06:05.896 [2024-04-24 19:12:52.683541] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:05.896 [2024-04-24 19:12:52.683596] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2893592 ] 00:06:05.896 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.896 [2024-04-24 19:12:52.752387] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.896 [2024-04-24 19:12:52.841803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.462 19:12:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:06.462 19:12:53 -- common/autotest_common.sh@850 -- # return 0 00:06:06.462 19:12:53 -- event/cpu_locks.sh@49 -- # locks_exist 2893592 00:06:06.462 19:12:53 -- event/cpu_locks.sh@22 -- # lslocks -p 2893592 00:06:06.718 19:12:53 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:06.975 lslocks: write error 00:06:06.976 19:12:53 -- event/cpu_locks.sh@50 -- # killprocess 2893592 00:06:06.976 19:12:53 -- common/autotest_common.sh@936 -- # '[' -z 2893592 ']' 00:06:06.976 19:12:53 -- common/autotest_common.sh@940 -- # kill -0 2893592 00:06:06.976 19:12:53 -- common/autotest_common.sh@941 -- # uname 00:06:06.976 19:12:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.976 19:12:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2893592 00:06:06.976 19:12:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.976 19:12:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.976 19:12:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2893592' 00:06:06.976 killing process with pid 2893592 00:06:06.976 19:12:53 -- common/autotest_common.sh@955 -- # kill 2893592 00:06:06.976 19:12:53 -- common/autotest_common.sh@960 -- # wait 2893592 00:06:07.542 19:12:54 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2893592 00:06:07.542 19:12:54 -- common/autotest_common.sh@638 -- # local es=0 00:06:07.542 19:12:54 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2893592 00:06:07.542 19:12:54 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:07.542 19:12:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:07.542 19:12:54 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:07.542 19:12:54 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:07.542 19:12:54 -- common/autotest_common.sh@641 -- # waitforlisten 2893592 00:06:07.542 19:12:54 -- common/autotest_common.sh@817 -- # '[' -z 2893592 ']' 00:06:07.542 19:12:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.542 19:12:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:07.542 19:12:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.542 19:12:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:07.542 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:06:07.542 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2893592) - No such process 00:06:07.542 ERROR: process (pid: 2893592) is no longer running 00:06:07.542 19:12:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:07.542 19:12:54 -- common/autotest_common.sh@850 -- # return 1 00:06:07.542 19:12:54 -- common/autotest_common.sh@641 -- # es=1 00:06:07.542 19:12:54 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:07.542 19:12:54 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:07.542 19:12:54 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:07.542 19:12:54 -- event/cpu_locks.sh@54 -- # no_locks 00:06:07.542 19:12:54 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:07.542 19:12:54 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:07.542 19:12:54 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:07.543 00:06:07.543 real 0m1.651s 00:06:07.543 user 0m1.684s 00:06:07.543 sys 0m0.583s 00:06:07.543 19:12:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:07.543 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:06:07.543 ************************************ 00:06:07.543 END TEST default_locks 00:06:07.543 ************************************ 00:06:07.543 19:12:54 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:07.543 19:12:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:07.543 19:12:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.543 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:06:07.543 ************************************ 00:06:07.543 START TEST default_locks_via_rpc 00:06:07.543 ************************************ 00:06:07.543 19:12:54 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:06:07.543 19:12:54 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2893809 00:06:07.543 19:12:54 -- event/cpu_locks.sh@63 -- # waitforlisten 2893809 00:06:07.543 19:12:54 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:07.543 19:12:54 -- common/autotest_common.sh@817 -- # '[' -z 2893809 ']' 00:06:07.543 19:12:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:07.543 19:12:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:07.543 19:12:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:07.543 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:07.543 19:12:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:07.543 19:12:54 -- common/autotest_common.sh@10 -- # set +x 00:06:07.543 [2024-04-24 19:12:54.520641] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:07.543 [2024-04-24 19:12:54.520692] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2893809 ] 00:06:07.543 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.801 [2024-04-24 19:12:54.592378] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.801 [2024-04-24 19:12:54.682114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.367 19:12:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:08.367 19:12:55 -- common/autotest_common.sh@850 -- # return 0 00:06:08.367 19:12:55 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:08.367 19:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:08.367 19:12:55 -- common/autotest_common.sh@10 -- # set +x 00:06:08.367 19:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:08.367 19:12:55 -- event/cpu_locks.sh@67 -- # no_locks 00:06:08.367 19:12:55 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:08.367 19:12:55 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:08.367 19:12:55 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:08.367 19:12:55 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:08.367 19:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:08.367 19:12:55 -- common/autotest_common.sh@10 -- # set +x 00:06:08.367 19:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:08.367 19:12:55 -- event/cpu_locks.sh@71 -- # locks_exist 2893809 00:06:08.367 19:12:55 -- event/cpu_locks.sh@22 -- # lslocks -p 2893809 00:06:08.367 19:12:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:08.933 19:12:55 -- event/cpu_locks.sh@73 -- # killprocess 2893809 00:06:08.933 19:12:55 -- common/autotest_common.sh@936 -- # '[' -z 2893809 ']' 00:06:08.933 19:12:55 -- common/autotest_common.sh@940 -- # kill -0 2893809 00:06:08.933 19:12:55 -- common/autotest_common.sh@941 -- # uname 00:06:08.933 19:12:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:08.933 19:12:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2893809 00:06:08.933 19:12:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:08.933 19:12:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:08.933 19:12:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2893809' 00:06:08.933 killing process with pid 2893809 00:06:08.933 19:12:55 -- common/autotest_common.sh@955 -- # kill 2893809 00:06:08.933 19:12:55 -- common/autotest_common.sh@960 -- # wait 2893809 00:06:09.499 00:06:09.499 real 0m1.810s 00:06:09.499 user 0m1.878s 00:06:09.499 sys 0m0.649s 00:06:09.499 19:12:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:09.499 19:12:56 -- common/autotest_common.sh@10 -- # set +x 00:06:09.499 ************************************ 00:06:09.499 END TEST default_locks_via_rpc 00:06:09.499 ************************************ 00:06:09.499 19:12:56 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:09.499 19:12:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:09.499 19:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.499 19:12:56 -- common/autotest_common.sh@10 -- # set +x 00:06:09.499 ************************************ 00:06:09.499 START TEST non_locking_app_on_locked_coremask 00:06:09.499 ************************************ 00:06:09.499 19:12:56 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:06:09.499 19:12:56 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2894127 00:06:09.499 19:12:56 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:09.499 19:12:56 -- event/cpu_locks.sh@81 -- # waitforlisten 2894127 /var/tmp/spdk.sock 00:06:09.499 19:12:56 -- common/autotest_common.sh@817 -- # '[' -z 2894127 ']' 00:06:09.499 19:12:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:09.499 19:12:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:09.499 19:12:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:09.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:09.499 19:12:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:09.499 19:12:56 -- common/autotest_common.sh@10 -- # set +x 00:06:09.499 [2024-04-24 19:12:56.519864] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:09.499 [2024-04-24 19:12:56.519920] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2894127 ] 00:06:09.756 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.756 [2024-04-24 19:12:56.592202] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.756 [2024-04-24 19:12:56.683570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.321 19:12:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:10.321 19:12:57 -- common/autotest_common.sh@850 -- # return 0 00:06:10.321 19:12:57 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2894222 00:06:10.321 19:12:57 -- event/cpu_locks.sh@85 -- # waitforlisten 2894222 /var/tmp/spdk2.sock 00:06:10.321 19:12:57 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:10.321 19:12:57 -- common/autotest_common.sh@817 -- # '[' -z 2894222 ']' 00:06:10.321 19:12:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:10.321 19:12:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:10.321 19:12:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:10.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:10.321 19:12:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:10.321 19:12:57 -- common/autotest_common.sh@10 -- # set +x 00:06:10.577 [2024-04-24 19:12:57.367262] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:10.577 [2024-04-24 19:12:57.367324] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2894222 ] 00:06:10.577 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.577 [2024-04-24 19:12:57.461382] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:10.577 [2024-04-24 19:12:57.461404] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.834 [2024-04-24 19:12:57.627306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.398 19:12:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:11.398 19:12:58 -- common/autotest_common.sh@850 -- # return 0 00:06:11.398 19:12:58 -- event/cpu_locks.sh@87 -- # locks_exist 2894127 00:06:11.398 19:12:58 -- event/cpu_locks.sh@22 -- # lslocks -p 2894127 00:06:11.398 19:12:58 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:12.329 lslocks: write error 00:06:12.329 19:12:59 -- event/cpu_locks.sh@89 -- # killprocess 2894127 00:06:12.329 19:12:59 -- common/autotest_common.sh@936 -- # '[' -z 2894127 ']' 00:06:12.329 19:12:59 -- common/autotest_common.sh@940 -- # kill -0 2894127 00:06:12.329 19:12:59 -- common/autotest_common.sh@941 -- # uname 00:06:12.329 19:12:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.329 19:12:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2894127 00:06:12.329 19:12:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.329 19:12:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.329 19:12:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2894127' 00:06:12.329 killing process with pid 2894127 00:06:12.329 19:12:59 -- common/autotest_common.sh@955 -- # kill 2894127 00:06:12.329 19:12:59 -- common/autotest_common.sh@960 -- # wait 2894127 00:06:12.893 19:12:59 -- event/cpu_locks.sh@90 -- # killprocess 2894222 00:06:12.893 19:12:59 -- common/autotest_common.sh@936 -- # '[' -z 2894222 ']' 00:06:12.893 19:12:59 -- common/autotest_common.sh@940 -- # kill -0 2894222 00:06:12.893 19:12:59 -- common/autotest_common.sh@941 -- # uname 00:06:12.893 19:12:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.893 19:12:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2894222 00:06:12.893 19:12:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.893 19:12:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.893 19:12:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2894222' 00:06:12.893 killing process with pid 2894222 00:06:12.893 19:12:59 -- common/autotest_common.sh@955 -- # kill 2894222 00:06:12.893 19:12:59 -- common/autotest_common.sh@960 -- # wait 2894222 00:06:13.459 00:06:13.459 real 0m3.812s 00:06:13.459 user 0m3.992s 00:06:13.459 sys 0m1.225s 00:06:13.459 19:13:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:13.459 19:13:00 -- common/autotest_common.sh@10 -- # set +x 00:06:13.459 ************************************ 00:06:13.459 END TEST non_locking_app_on_locked_coremask 00:06:13.459 ************************************ 00:06:13.459 19:13:00 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:13.459 19:13:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:13.459 19:13:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.459 19:13:00 -- common/autotest_common.sh@10 -- # set +x 00:06:13.717 ************************************ 00:06:13.717 START TEST locking_app_on_unlocked_coremask 00:06:13.717 ************************************ 00:06:13.717 19:13:00 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:06:13.717 19:13:00 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2894659 00:06:13.717 19:13:00 -- event/cpu_locks.sh@99 -- # waitforlisten 2894659 /var/tmp/spdk.sock 00:06:13.717 19:13:00 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:13.717 19:13:00 -- common/autotest_common.sh@817 -- # '[' -z 2894659 ']' 00:06:13.717 19:13:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.717 19:13:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:13.717 19:13:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.717 19:13:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:13.717 19:13:00 -- common/autotest_common.sh@10 -- # set +x 00:06:13.717 [2024-04-24 19:13:00.538124] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:13.717 [2024-04-24 19:13:00.538178] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2894659 ] 00:06:13.717 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.717 [2024-04-24 19:13:00.612314] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:13.717 [2024-04-24 19:13:00.612346] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.717 [2024-04-24 19:13:00.700066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.650 19:13:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:14.650 19:13:01 -- common/autotest_common.sh@850 -- # return 0 00:06:14.650 19:13:01 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2894812 00:06:14.650 19:13:01 -- event/cpu_locks.sh@103 -- # waitforlisten 2894812 /var/tmp/spdk2.sock 00:06:14.650 19:13:01 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:14.650 19:13:01 -- common/autotest_common.sh@817 -- # '[' -z 2894812 ']' 00:06:14.650 19:13:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:14.650 19:13:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:14.650 19:13:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:14.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:14.650 19:13:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:14.650 19:13:01 -- common/autotest_common.sh@10 -- # set +x 00:06:14.650 [2024-04-24 19:13:01.392165] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:14.650 [2024-04-24 19:13:01.392222] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2894812 ] 00:06:14.650 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.650 [2024-04-24 19:13:01.484996] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.650 [2024-04-24 19:13:01.651014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.215 19:13:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:15.215 19:13:02 -- common/autotest_common.sh@850 -- # return 0 00:06:15.215 19:13:02 -- event/cpu_locks.sh@105 -- # locks_exist 2894812 00:06:15.215 19:13:02 -- event/cpu_locks.sh@22 -- # lslocks -p 2894812 00:06:15.215 19:13:02 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:16.586 lslocks: write error 00:06:16.586 19:13:03 -- event/cpu_locks.sh@107 -- # killprocess 2894659 00:06:16.586 19:13:03 -- common/autotest_common.sh@936 -- # '[' -z 2894659 ']' 00:06:16.586 19:13:03 -- common/autotest_common.sh@940 -- # kill -0 2894659 00:06:16.586 19:13:03 -- common/autotest_common.sh@941 -- # uname 00:06:16.586 19:13:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:16.586 19:13:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2894659 00:06:16.586 19:13:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:16.586 19:13:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:16.586 19:13:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2894659' 00:06:16.586 killing process with pid 2894659 00:06:16.586 19:13:03 -- common/autotest_common.sh@955 -- # kill 2894659 00:06:16.586 19:13:03 -- common/autotest_common.sh@960 -- # wait 2894659 00:06:17.521 19:13:04 -- event/cpu_locks.sh@108 -- # killprocess 2894812 00:06:17.522 19:13:04 -- common/autotest_common.sh@936 -- # '[' -z 2894812 ']' 00:06:17.522 19:13:04 -- common/autotest_common.sh@940 -- # kill -0 2894812 00:06:17.522 19:13:04 -- common/autotest_common.sh@941 -- # uname 00:06:17.522 19:13:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:17.522 19:13:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2894812 00:06:17.522 19:13:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:17.522 19:13:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:17.522 19:13:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2894812' 00:06:17.522 killing process with pid 2894812 00:06:17.522 19:13:04 -- common/autotest_common.sh@955 -- # kill 2894812 00:06:17.522 19:13:04 -- common/autotest_common.sh@960 -- # wait 2894812 00:06:17.779 00:06:17.779 real 0m4.152s 00:06:17.779 user 0m4.387s 00:06:17.779 sys 0m1.407s 00:06:17.779 19:13:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:17.779 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:17.779 ************************************ 00:06:17.779 END TEST locking_app_on_unlocked_coremask 00:06:17.779 ************************************ 00:06:17.779 19:13:04 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:17.779 19:13:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:17.779 19:13:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.779 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:18.038 ************************************ 00:06:18.038 START TEST locking_app_on_locked_coremask 00:06:18.038 ************************************ 00:06:18.038 19:13:04 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:06:18.038 19:13:04 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2895394 00:06:18.038 19:13:04 -- event/cpu_locks.sh@116 -- # waitforlisten 2895394 /var/tmp/spdk.sock 00:06:18.038 19:13:04 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:18.038 19:13:04 -- common/autotest_common.sh@817 -- # '[' -z 2895394 ']' 00:06:18.038 19:13:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.038 19:13:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:18.038 19:13:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.038 19:13:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:18.038 19:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:18.038 [2024-04-24 19:13:04.904086] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:18.038 [2024-04-24 19:13:04.904146] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2895394 ] 00:06:18.038 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.038 [2024-04-24 19:13:04.976726] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.297 [2024-04-24 19:13:05.064572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.864 19:13:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:18.864 19:13:05 -- common/autotest_common.sh@850 -- # return 0 00:06:18.864 19:13:05 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2895408 00:06:18.864 19:13:05 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2895408 /var/tmp/spdk2.sock 00:06:18.864 19:13:05 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:18.864 19:13:05 -- common/autotest_common.sh@638 -- # local es=0 00:06:18.864 19:13:05 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2895408 /var/tmp/spdk2.sock 00:06:18.864 19:13:05 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:18.864 19:13:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:18.864 19:13:05 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:18.864 19:13:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:18.864 19:13:05 -- common/autotest_common.sh@641 -- # waitforlisten 2895408 /var/tmp/spdk2.sock 00:06:18.864 19:13:05 -- common/autotest_common.sh@817 -- # '[' -z 2895408 ']' 00:06:18.864 19:13:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:18.864 19:13:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:18.864 19:13:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:18.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:18.864 19:13:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:18.864 19:13:05 -- common/autotest_common.sh@10 -- # set +x 00:06:18.864 [2024-04-24 19:13:05.749762] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:18.864 [2024-04-24 19:13:05.749821] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2895408 ] 00:06:18.864 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.864 [2024-04-24 19:13:05.850085] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2895394 has claimed it. 00:06:18.864 [2024-04-24 19:13:05.850130] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:19.429 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2895408) - No such process 00:06:19.429 ERROR: process (pid: 2895408) is no longer running 00:06:19.429 19:13:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:19.429 19:13:06 -- common/autotest_common.sh@850 -- # return 1 00:06:19.429 19:13:06 -- common/autotest_common.sh@641 -- # es=1 00:06:19.429 19:13:06 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:19.429 19:13:06 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:19.429 19:13:06 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:19.429 19:13:06 -- event/cpu_locks.sh@122 -- # locks_exist 2895394 00:06:19.429 19:13:06 -- event/cpu_locks.sh@22 -- # lslocks -p 2895394 00:06:19.429 19:13:06 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:19.995 lslocks: write error 00:06:19.995 19:13:07 -- event/cpu_locks.sh@124 -- # killprocess 2895394 00:06:19.995 19:13:07 -- common/autotest_common.sh@936 -- # '[' -z 2895394 ']' 00:06:19.995 19:13:07 -- common/autotest_common.sh@940 -- # kill -0 2895394 00:06:19.995 19:13:07 -- common/autotest_common.sh@941 -- # uname 00:06:19.995 19:13:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:19.995 19:13:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2895394 00:06:20.254 19:13:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.254 19:13:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.254 19:13:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2895394' 00:06:20.254 killing process with pid 2895394 00:06:20.254 19:13:07 -- common/autotest_common.sh@955 -- # kill 2895394 00:06:20.254 19:13:07 -- common/autotest_common.sh@960 -- # wait 2895394 00:06:20.512 00:06:20.512 real 0m2.572s 00:06:20.512 user 0m2.766s 00:06:20.512 sys 0m0.833s 00:06:20.512 19:13:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:20.512 19:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:20.512 ************************************ 00:06:20.512 END TEST locking_app_on_locked_coremask 00:06:20.512 ************************************ 00:06:20.512 19:13:07 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:20.512 19:13:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:20.512 19:13:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.512 19:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:20.770 ************************************ 00:06:20.770 START TEST locking_overlapped_coremask 00:06:20.770 ************************************ 00:06:20.770 19:13:07 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:06:20.770 19:13:07 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2895795 00:06:20.770 19:13:07 -- event/cpu_locks.sh@133 -- # waitforlisten 2895795 /var/tmp/spdk.sock 00:06:20.770 19:13:07 -- common/autotest_common.sh@817 -- # '[' -z 2895795 ']' 00:06:20.770 19:13:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:20.770 19:13:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:20.770 19:13:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:20.770 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:20.770 19:13:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:20.770 19:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:20.770 19:13:07 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:20.770 [2024-04-24 19:13:07.657975] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:20.770 [2024-04-24 19:13:07.658028] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2895795 ] 00:06:20.770 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.770 [2024-04-24 19:13:07.729520] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:21.028 [2024-04-24 19:13:07.822115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.028 [2024-04-24 19:13:07.822201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.028 [2024-04-24 19:13:07.822204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.593 19:13:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:21.593 19:13:08 -- common/autotest_common.sh@850 -- # return 0 00:06:21.593 19:13:08 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2895815 00:06:21.593 19:13:08 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2895815 /var/tmp/spdk2.sock 00:06:21.593 19:13:08 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:21.593 19:13:08 -- common/autotest_common.sh@638 -- # local es=0 00:06:21.593 19:13:08 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 2895815 /var/tmp/spdk2.sock 00:06:21.593 19:13:08 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:21.593 19:13:08 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:21.593 19:13:08 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:21.593 19:13:08 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:21.593 19:13:08 -- common/autotest_common.sh@641 -- # waitforlisten 2895815 /var/tmp/spdk2.sock 00:06:21.593 19:13:08 -- common/autotest_common.sh@817 -- # '[' -z 2895815 ']' 00:06:21.593 19:13:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:21.593 19:13:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:21.594 19:13:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:21.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:21.594 19:13:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:21.594 19:13:08 -- common/autotest_common.sh@10 -- # set +x 00:06:21.594 [2024-04-24 19:13:08.514203] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:21.594 [2024-04-24 19:13:08.514261] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2895815 ] 00:06:21.594 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.852 [2024-04-24 19:13:08.616884] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2895795 has claimed it. 00:06:21.852 [2024-04-24 19:13:08.616923] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:22.419 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (2895815) - No such process 00:06:22.419 ERROR: process (pid: 2895815) is no longer running 00:06:22.419 19:13:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:22.419 19:13:09 -- common/autotest_common.sh@850 -- # return 1 00:06:22.419 19:13:09 -- common/autotest_common.sh@641 -- # es=1 00:06:22.419 19:13:09 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:22.419 19:13:09 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:22.419 19:13:09 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:22.419 19:13:09 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:22.419 19:13:09 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:22.419 19:13:09 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:22.419 19:13:09 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:22.419 19:13:09 -- event/cpu_locks.sh@141 -- # killprocess 2895795 00:06:22.419 19:13:09 -- common/autotest_common.sh@936 -- # '[' -z 2895795 ']' 00:06:22.419 19:13:09 -- common/autotest_common.sh@940 -- # kill -0 2895795 00:06:22.419 19:13:09 -- common/autotest_common.sh@941 -- # uname 00:06:22.419 19:13:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.419 19:13:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2895795 00:06:22.419 19:13:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.419 19:13:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.419 19:13:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2895795' 00:06:22.419 killing process with pid 2895795 00:06:22.419 19:13:09 -- common/autotest_common.sh@955 -- # kill 2895795 00:06:22.419 19:13:09 -- common/autotest_common.sh@960 -- # wait 2895795 00:06:22.678 00:06:22.678 real 0m1.953s 00:06:22.678 user 0m5.346s 00:06:22.678 sys 0m0.497s 00:06:22.678 19:13:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:22.678 19:13:09 -- common/autotest_common.sh@10 -- # set +x 00:06:22.678 ************************************ 00:06:22.678 END TEST locking_overlapped_coremask 00:06:22.678 ************************************ 00:06:22.678 19:13:09 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:22.678 19:13:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.678 19:13:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.678 19:13:09 -- common/autotest_common.sh@10 -- # set +x 00:06:22.937 ************************************ 00:06:22.937 START TEST locking_overlapped_coremask_via_rpc 00:06:22.937 ************************************ 00:06:22.937 19:13:09 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:06:22.937 19:13:09 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2896032 00:06:22.937 19:13:09 -- event/cpu_locks.sh@149 -- # waitforlisten 2896032 /var/tmp/spdk.sock 00:06:22.937 19:13:09 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:22.937 19:13:09 -- common/autotest_common.sh@817 -- # '[' -z 2896032 ']' 00:06:22.937 19:13:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.937 19:13:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:22.937 19:13:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.937 19:13:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:22.937 19:13:09 -- common/autotest_common.sh@10 -- # set +x 00:06:22.937 [2024-04-24 19:13:09.816128] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:22.937 [2024-04-24 19:13:09.816186] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896032 ] 00:06:22.937 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.937 [2024-04-24 19:13:09.889537] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:22.937 [2024-04-24 19:13:09.889569] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:23.195 [2024-04-24 19:13:09.979537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.195 [2024-04-24 19:13:09.979632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.195 [2024-04-24 19:13:09.979628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.761 19:13:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:23.761 19:13:10 -- common/autotest_common.sh@850 -- # return 0 00:06:23.761 19:13:10 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:23.761 19:13:10 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2896212 00:06:23.761 19:13:10 -- event/cpu_locks.sh@153 -- # waitforlisten 2896212 /var/tmp/spdk2.sock 00:06:23.761 19:13:10 -- common/autotest_common.sh@817 -- # '[' -z 2896212 ']' 00:06:23.761 19:13:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:23.761 19:13:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:23.761 19:13:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:23.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:23.761 19:13:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:23.761 19:13:10 -- common/autotest_common.sh@10 -- # set +x 00:06:23.761 [2024-04-24 19:13:10.659630] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:23.761 [2024-04-24 19:13:10.659688] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896212 ] 00:06:23.761 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.761 [2024-04-24 19:13:10.759575] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:23.761 [2024-04-24 19:13:10.759606] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:24.019 [2024-04-24 19:13:10.927867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.019 [2024-04-24 19:13:10.931593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.019 [2024-04-24 19:13:10.931594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:24.585 19:13:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:24.585 19:13:11 -- common/autotest_common.sh@850 -- # return 0 00:06:24.585 19:13:11 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:24.585 19:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:24.585 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:24.585 19:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:24.585 19:13:11 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:24.585 19:13:11 -- common/autotest_common.sh@638 -- # local es=0 00:06:24.585 19:13:11 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:24.585 19:13:11 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:06:24.585 19:13:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:24.585 19:13:11 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:06:24.585 19:13:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:24.585 19:13:11 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:24.585 19:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:24.585 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:24.585 [2024-04-24 19:13:11.507623] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2896032 has claimed it. 00:06:24.585 request: 00:06:24.585 { 00:06:24.585 "method": "framework_enable_cpumask_locks", 00:06:24.585 "req_id": 1 00:06:24.585 } 00:06:24.585 Got JSON-RPC error response 00:06:24.585 response: 00:06:24.585 { 00:06:24.585 "code": -32603, 00:06:24.585 "message": "Failed to claim CPU core: 2" 00:06:24.585 } 00:06:24.585 19:13:11 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:24.585 19:13:11 -- common/autotest_common.sh@641 -- # es=1 00:06:24.585 19:13:11 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:24.585 19:13:11 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:24.585 19:13:11 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:24.585 19:13:11 -- event/cpu_locks.sh@158 -- # waitforlisten 2896032 /var/tmp/spdk.sock 00:06:24.585 19:13:11 -- common/autotest_common.sh@817 -- # '[' -z 2896032 ']' 00:06:24.585 19:13:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:24.585 19:13:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:24.585 19:13:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:24.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:24.585 19:13:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:24.585 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:24.843 19:13:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:24.843 19:13:11 -- common/autotest_common.sh@850 -- # return 0 00:06:24.844 19:13:11 -- event/cpu_locks.sh@159 -- # waitforlisten 2896212 /var/tmp/spdk2.sock 00:06:24.844 19:13:11 -- common/autotest_common.sh@817 -- # '[' -z 2896212 ']' 00:06:24.844 19:13:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:24.844 19:13:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:24.844 19:13:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:24.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:24.844 19:13:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:24.844 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:25.102 19:13:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:25.103 19:13:11 -- common/autotest_common.sh@850 -- # return 0 00:06:25.103 19:13:11 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:25.103 19:13:11 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:25.103 19:13:11 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:25.103 19:13:11 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:25.103 00:06:25.103 real 0m2.151s 00:06:25.103 user 0m0.874s 00:06:25.103 sys 0m0.213s 00:06:25.103 19:13:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.103 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:25.103 ************************************ 00:06:25.103 END TEST locking_overlapped_coremask_via_rpc 00:06:25.103 ************************************ 00:06:25.103 19:13:11 -- event/cpu_locks.sh@174 -- # cleanup 00:06:25.103 19:13:11 -- event/cpu_locks.sh@15 -- # [[ -z 2896032 ]] 00:06:25.103 19:13:11 -- event/cpu_locks.sh@15 -- # killprocess 2896032 00:06:25.103 19:13:11 -- common/autotest_common.sh@936 -- # '[' -z 2896032 ']' 00:06:25.103 19:13:11 -- common/autotest_common.sh@940 -- # kill -0 2896032 00:06:25.103 19:13:11 -- common/autotest_common.sh@941 -- # uname 00:06:25.103 19:13:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.103 19:13:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2896032 00:06:25.103 19:13:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.103 19:13:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.103 19:13:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2896032' 00:06:25.103 killing process with pid 2896032 00:06:25.103 19:13:12 -- common/autotest_common.sh@955 -- # kill 2896032 00:06:25.103 19:13:12 -- common/autotest_common.sh@960 -- # wait 2896032 00:06:25.671 19:13:12 -- event/cpu_locks.sh@16 -- # [[ -z 2896212 ]] 00:06:25.671 19:13:12 -- event/cpu_locks.sh@16 -- # killprocess 2896212 00:06:25.671 19:13:12 -- common/autotest_common.sh@936 -- # '[' -z 2896212 ']' 00:06:25.671 19:13:12 -- common/autotest_common.sh@940 -- # kill -0 2896212 00:06:25.671 19:13:12 -- common/autotest_common.sh@941 -- # uname 00:06:25.671 19:13:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.671 19:13:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2896212 00:06:25.671 19:13:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:25.671 19:13:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:25.671 19:13:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2896212' 00:06:25.671 killing process with pid 2896212 00:06:25.671 19:13:12 -- common/autotest_common.sh@955 -- # kill 2896212 00:06:25.671 19:13:12 -- common/autotest_common.sh@960 -- # wait 2896212 00:06:25.929 19:13:12 -- event/cpu_locks.sh@18 -- # rm -f 00:06:25.929 19:13:12 -- event/cpu_locks.sh@1 -- # cleanup 00:06:25.929 19:13:12 -- event/cpu_locks.sh@15 -- # [[ -z 2896032 ]] 00:06:25.929 19:13:12 -- event/cpu_locks.sh@15 -- # killprocess 2896032 00:06:25.929 19:13:12 -- common/autotest_common.sh@936 -- # '[' -z 2896032 ']' 00:06:25.929 19:13:12 -- common/autotest_common.sh@940 -- # kill -0 2896032 00:06:25.929 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2896032) - No such process 00:06:25.929 19:13:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2896032 is not found' 00:06:25.929 Process with pid 2896032 is not found 00:06:25.929 19:13:12 -- event/cpu_locks.sh@16 -- # [[ -z 2896212 ]] 00:06:25.929 19:13:12 -- event/cpu_locks.sh@16 -- # killprocess 2896212 00:06:25.929 19:13:12 -- common/autotest_common.sh@936 -- # '[' -z 2896212 ']' 00:06:25.929 19:13:12 -- common/autotest_common.sh@940 -- # kill -0 2896212 00:06:25.929 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2896212) - No such process 00:06:25.929 19:13:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2896212 is not found' 00:06:25.929 Process with pid 2896212 is not found 00:06:25.929 19:13:12 -- event/cpu_locks.sh@18 -- # rm -f 00:06:25.929 00:06:25.929 real 0m20.450s 00:06:25.929 user 0m32.313s 00:06:25.929 sys 0m6.880s 00:06:25.929 19:13:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.929 19:13:12 -- common/autotest_common.sh@10 -- # set +x 00:06:25.929 ************************************ 00:06:25.929 END TEST cpu_locks 00:06:25.929 ************************************ 00:06:25.929 00:06:25.929 real 0m47.582s 00:06:25.929 user 1m23.016s 00:06:25.929 sys 0m11.615s 00:06:25.929 19:13:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.929 19:13:12 -- common/autotest_common.sh@10 -- # set +x 00:06:25.929 ************************************ 00:06:25.929 END TEST event 00:06:25.929 ************************************ 00:06:25.929 19:13:12 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:06:25.929 19:13:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.929 19:13:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.929 19:13:12 -- common/autotest_common.sh@10 -- # set +x 00:06:26.188 ************************************ 00:06:26.188 START TEST thread 00:06:26.188 ************************************ 00:06:26.188 19:13:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:06:26.188 * Looking for test storage... 00:06:26.188 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:06:26.188 19:13:13 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:26.188 19:13:13 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:26.188 19:13:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.188 19:13:13 -- common/autotest_common.sh@10 -- # set +x 00:06:26.453 ************************************ 00:06:26.453 START TEST thread_poller_perf 00:06:26.453 ************************************ 00:06:26.453 19:13:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:26.453 [2024-04-24 19:13:13.351132] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:26.453 [2024-04-24 19:13:13.351196] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896691 ] 00:06:26.453 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.453 [2024-04-24 19:13:13.423663] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.727 [2024-04-24 19:13:13.513556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.727 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:27.727 ====================================== 00:06:27.727 busy:2306257590 (cyc) 00:06:27.727 total_run_count: 417000 00:06:27.727 tsc_hz: 2300000000 (cyc) 00:06:27.727 ====================================== 00:06:27.727 poller_cost: 5530 (cyc), 2404 (nsec) 00:06:27.727 00:06:27.727 real 0m1.293s 00:06:27.727 user 0m1.196s 00:06:27.727 sys 0m0.091s 00:06:27.727 19:13:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:27.727 19:13:14 -- common/autotest_common.sh@10 -- # set +x 00:06:27.727 ************************************ 00:06:27.727 END TEST thread_poller_perf 00:06:27.727 ************************************ 00:06:27.727 19:13:14 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:27.727 19:13:14 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:27.727 19:13:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.727 19:13:14 -- common/autotest_common.sh@10 -- # set +x 00:06:27.986 ************************************ 00:06:27.986 START TEST thread_poller_perf 00:06:27.986 ************************************ 00:06:27.986 19:13:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:27.986 [2024-04-24 19:13:14.853943] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:27.986 [2024-04-24 19:13:14.854006] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896904 ] 00:06:27.986 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.986 [2024-04-24 19:13:14.927237] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.244 [2024-04-24 19:13:15.019837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.244 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:29.178 ====================================== 00:06:29.178 busy:2301730634 (cyc) 00:06:29.178 total_run_count: 5425000 00:06:29.178 tsc_hz: 2300000000 (cyc) 00:06:29.178 ====================================== 00:06:29.178 poller_cost: 424 (cyc), 184 (nsec) 00:06:29.178 00:06:29.178 real 0m1.291s 00:06:29.178 user 0m1.198s 00:06:29.178 sys 0m0.088s 00:06:29.178 19:13:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:29.178 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:06:29.178 ************************************ 00:06:29.178 END TEST thread_poller_perf 00:06:29.178 ************************************ 00:06:29.178 19:13:16 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:29.178 00:06:29.178 real 0m3.089s 00:06:29.178 user 0m2.562s 00:06:29.178 sys 0m0.484s 00:06:29.178 19:13:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:29.178 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:06:29.178 ************************************ 00:06:29.178 END TEST thread 00:06:29.178 ************************************ 00:06:29.437 19:13:16 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:06:29.437 19:13:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.437 19:13:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.437 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:06:29.437 ************************************ 00:06:29.437 START TEST accel 00:06:29.437 ************************************ 00:06:29.437 19:13:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:06:29.695 * Looking for test storage... 00:06:29.695 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:06:29.695 19:13:16 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:06:29.695 19:13:16 -- accel/accel.sh@82 -- # get_expected_opcs 00:06:29.695 19:13:16 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:29.695 19:13:16 -- accel/accel.sh@62 -- # spdk_tgt_pid=2897157 00:06:29.695 19:13:16 -- accel/accel.sh@63 -- # waitforlisten 2897157 00:06:29.695 19:13:16 -- common/autotest_common.sh@817 -- # '[' -z 2897157 ']' 00:06:29.695 19:13:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.695 19:13:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:29.696 19:13:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.696 19:13:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:29.696 19:13:16 -- common/autotest_common.sh@10 -- # set +x 00:06:29.696 19:13:16 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:29.696 19:13:16 -- accel/accel.sh@61 -- # build_accel_config 00:06:29.696 19:13:16 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:29.696 19:13:16 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:29.696 19:13:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.696 19:13:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.696 19:13:16 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:29.696 19:13:16 -- accel/accel.sh@40 -- # local IFS=, 00:06:29.696 19:13:16 -- accel/accel.sh@41 -- # jq -r . 00:06:29.696 [2024-04-24 19:13:16.536007] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:29.696 [2024-04-24 19:13:16.536063] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2897157 ] 00:06:29.696 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.696 [2024-04-24 19:13:16.607394] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.696 [2024-04-24 19:13:16.694118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.630 19:13:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:30.630 19:13:17 -- common/autotest_common.sh@850 -- # return 0 00:06:30.630 19:13:17 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:06:30.630 19:13:17 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:06:30.630 19:13:17 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:06:30.630 19:13:17 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:06:30.630 19:13:17 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:30.630 19:13:17 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:06:30.630 19:13:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:30.630 19:13:17 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:30.630 19:13:17 -- common/autotest_common.sh@10 -- # set +x 00:06:30.630 19:13:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:30.630 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.630 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.630 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # IFS== 00:06:30.631 19:13:17 -- accel/accel.sh@72 -- # read -r opc module 00:06:30.631 19:13:17 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:30.631 19:13:17 -- accel/accel.sh@75 -- # killprocess 2897157 00:06:30.631 19:13:17 -- common/autotest_common.sh@936 -- # '[' -z 2897157 ']' 00:06:30.631 19:13:17 -- common/autotest_common.sh@940 -- # kill -0 2897157 00:06:30.631 19:13:17 -- common/autotest_common.sh@941 -- # uname 00:06:30.631 19:13:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.631 19:13:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2897157 00:06:30.631 19:13:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:30.631 19:13:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:30.631 19:13:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2897157' 00:06:30.631 killing process with pid 2897157 00:06:30.631 19:13:17 -- common/autotest_common.sh@955 -- # kill 2897157 00:06:30.631 19:13:17 -- common/autotest_common.sh@960 -- # wait 2897157 00:06:30.889 19:13:17 -- accel/accel.sh@76 -- # trap - ERR 00:06:30.889 19:13:17 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:06:30.889 19:13:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:30.889 19:13:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.889 19:13:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.147 19:13:17 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:06:31.148 19:13:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:31.148 19:13:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.148 19:13:17 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:31.148 19:13:17 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:31.148 19:13:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.148 19:13:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.148 19:13:17 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:31.148 19:13:17 -- accel/accel.sh@40 -- # local IFS=, 00:06:31.148 19:13:17 -- accel/accel.sh@41 -- # jq -r . 00:06:31.148 19:13:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:31.148 19:13:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.148 19:13:18 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:31.148 19:13:18 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:31.148 19:13:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.148 19:13:18 -- common/autotest_common.sh@10 -- # set +x 00:06:31.406 ************************************ 00:06:31.406 START TEST accel_missing_filename 00:06:31.406 ************************************ 00:06:31.406 19:13:18 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:06:31.406 19:13:18 -- common/autotest_common.sh@638 -- # local es=0 00:06:31.406 19:13:18 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:31.406 19:13:18 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:06:31.406 19:13:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:31.406 19:13:18 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:06:31.406 19:13:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:31.406 19:13:18 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:06:31.406 19:13:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:31.406 19:13:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.406 19:13:18 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:31.406 19:13:18 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:31.406 19:13:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.406 19:13:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.406 19:13:18 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:31.406 19:13:18 -- accel/accel.sh@40 -- # local IFS=, 00:06:31.406 19:13:18 -- accel/accel.sh@41 -- # jq -r . 00:06:31.406 [2024-04-24 19:13:18.207024] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:31.406 [2024-04-24 19:13:18.207090] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2897460 ] 00:06:31.406 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.406 [2024-04-24 19:13:18.281023] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.406 [2024-04-24 19:13:18.364802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.406 [2024-04-24 19:13:18.412959] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:31.665 [2024-04-24 19:13:18.483072] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:06:31.665 A filename is required. 00:06:31.665 19:13:18 -- common/autotest_common.sh@641 -- # es=234 00:06:31.665 19:13:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:31.665 19:13:18 -- common/autotest_common.sh@650 -- # es=106 00:06:31.665 19:13:18 -- common/autotest_common.sh@651 -- # case "$es" in 00:06:31.665 19:13:18 -- common/autotest_common.sh@658 -- # es=1 00:06:31.665 19:13:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:31.665 00:06:31.665 real 0m0.405s 00:06:31.665 user 0m0.297s 00:06:31.665 sys 0m0.144s 00:06:31.665 19:13:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:31.665 19:13:18 -- common/autotest_common.sh@10 -- # set +x 00:06:31.665 ************************************ 00:06:31.665 END TEST accel_missing_filename 00:06:31.665 ************************************ 00:06:31.665 19:13:18 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:31.665 19:13:18 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:31.665 19:13:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.665 19:13:18 -- common/autotest_common.sh@10 -- # set +x 00:06:31.923 ************************************ 00:06:31.923 START TEST accel_compress_verify 00:06:31.923 ************************************ 00:06:31.923 19:13:18 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:31.923 19:13:18 -- common/autotest_common.sh@638 -- # local es=0 00:06:31.924 19:13:18 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:31.924 19:13:18 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:06:31.924 19:13:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:31.924 19:13:18 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:06:31.924 19:13:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:31.924 19:13:18 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:31.924 19:13:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:31.924 19:13:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.924 19:13:18 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:31.924 19:13:18 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:31.924 19:13:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.924 19:13:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.924 19:13:18 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:31.924 19:13:18 -- accel/accel.sh@40 -- # local IFS=, 00:06:31.924 19:13:18 -- accel/accel.sh@41 -- # jq -r . 00:06:31.924 [2024-04-24 19:13:18.799011] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:31.924 [2024-04-24 19:13:18.799066] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2897592 ] 00:06:31.924 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.924 [2024-04-24 19:13:18.870190] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.182 [2024-04-24 19:13:18.954075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.182 [2024-04-24 19:13:19.002304] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:32.182 [2024-04-24 19:13:19.071848] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:06:32.182 00:06:32.182 Compression does not support the verify option, aborting. 00:06:32.182 19:13:19 -- common/autotest_common.sh@641 -- # es=161 00:06:32.182 19:13:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:32.182 19:13:19 -- common/autotest_common.sh@650 -- # es=33 00:06:32.182 19:13:19 -- common/autotest_common.sh@651 -- # case "$es" in 00:06:32.182 19:13:19 -- common/autotest_common.sh@658 -- # es=1 00:06:32.182 19:13:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:32.182 00:06:32.182 real 0m0.397s 00:06:32.182 user 0m0.283s 00:06:32.182 sys 0m0.150s 00:06:32.182 19:13:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:32.182 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.182 ************************************ 00:06:32.182 END TEST accel_compress_verify 00:06:32.182 ************************************ 00:06:32.440 19:13:19 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:32.440 19:13:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:32.440 19:13:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.440 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.440 ************************************ 00:06:32.440 START TEST accel_wrong_workload 00:06:32.440 ************************************ 00:06:32.440 19:13:19 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:06:32.440 19:13:19 -- common/autotest_common.sh@638 -- # local es=0 00:06:32.440 19:13:19 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:32.440 19:13:19 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:06:32.440 19:13:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:32.440 19:13:19 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:06:32.440 19:13:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:32.440 19:13:19 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:06:32.440 19:13:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:32.440 19:13:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.440 19:13:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:32.440 19:13:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:32.440 19:13:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.440 19:13:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.440 19:13:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:32.440 19:13:19 -- accel/accel.sh@40 -- # local IFS=, 00:06:32.440 19:13:19 -- accel/accel.sh@41 -- # jq -r . 00:06:32.440 Unsupported workload type: foobar 00:06:32.440 [2024-04-24 19:13:19.361579] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:32.440 accel_perf options: 00:06:32.440 [-h help message] 00:06:32.440 [-q queue depth per core] 00:06:32.440 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:32.440 [-T number of threads per core 00:06:32.440 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:32.440 [-t time in seconds] 00:06:32.440 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:32.440 [ dif_verify, , dif_generate, dif_generate_copy 00:06:32.440 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:32.440 [-l for compress/decompress workloads, name of uncompressed input file 00:06:32.440 [-S for crc32c workload, use this seed value (default 0) 00:06:32.440 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:32.440 [-f for fill workload, use this BYTE value (default 255) 00:06:32.440 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:32.440 [-y verify result if this switch is on] 00:06:32.440 [-a tasks to allocate per core (default: same value as -q)] 00:06:32.440 Can be used to spread operations across a wider range of memory. 00:06:32.441 19:13:19 -- common/autotest_common.sh@641 -- # es=1 00:06:32.441 19:13:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:32.441 19:13:19 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:32.441 19:13:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:32.441 00:06:32.441 real 0m0.032s 00:06:32.441 user 0m0.019s 00:06:32.441 sys 0m0.013s 00:06:32.441 19:13:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:32.441 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.441 ************************************ 00:06:32.441 END TEST accel_wrong_workload 00:06:32.441 ************************************ 00:06:32.441 Error: writing output failed: Broken pipe 00:06:32.441 19:13:19 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:32.441 19:13:19 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:32.441 19:13:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.441 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.699 ************************************ 00:06:32.699 START TEST accel_negative_buffers 00:06:32.699 ************************************ 00:06:32.699 19:13:19 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:32.699 19:13:19 -- common/autotest_common.sh@638 -- # local es=0 00:06:32.699 19:13:19 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:32.699 19:13:19 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:06:32.699 19:13:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:32.699 19:13:19 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:06:32.699 19:13:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:32.699 19:13:19 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:06:32.699 19:13:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:32.699 19:13:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.699 19:13:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:32.699 19:13:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:32.699 19:13:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.699 19:13:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.699 19:13:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:32.699 19:13:19 -- accel/accel.sh@40 -- # local IFS=, 00:06:32.699 19:13:19 -- accel/accel.sh@41 -- # jq -r . 00:06:32.699 -x option must be non-negative. 00:06:32.699 [2024-04-24 19:13:19.562429] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:32.699 accel_perf options: 00:06:32.699 [-h help message] 00:06:32.699 [-q queue depth per core] 00:06:32.699 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:32.699 [-T number of threads per core 00:06:32.699 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:32.699 [-t time in seconds] 00:06:32.699 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:32.699 [ dif_verify, , dif_generate, dif_generate_copy 00:06:32.699 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:32.699 [-l for compress/decompress workloads, name of uncompressed input file 00:06:32.699 [-S for crc32c workload, use this seed value (default 0) 00:06:32.699 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:32.699 [-f for fill workload, use this BYTE value (default 255) 00:06:32.699 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:32.699 [-y verify result if this switch is on] 00:06:32.699 [-a tasks to allocate per core (default: same value as -q)] 00:06:32.699 Can be used to spread operations across a wider range of memory. 00:06:32.699 19:13:19 -- common/autotest_common.sh@641 -- # es=1 00:06:32.699 19:13:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:32.699 19:13:19 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:32.699 19:13:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:32.699 00:06:32.699 real 0m0.035s 00:06:32.699 user 0m0.018s 00:06:32.699 sys 0m0.017s 00:06:32.699 19:13:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:32.699 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.699 ************************************ 00:06:32.699 END TEST accel_negative_buffers 00:06:32.699 ************************************ 00:06:32.699 Error: writing output failed: Broken pipe 00:06:32.699 19:13:19 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:32.699 19:13:19 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:32.699 19:13:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.699 19:13:19 -- common/autotest_common.sh@10 -- # set +x 00:06:32.957 ************************************ 00:06:32.957 START TEST accel_crc32c 00:06:32.957 ************************************ 00:06:32.957 19:13:19 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:32.957 19:13:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.957 19:13:19 -- accel/accel.sh@17 -- # local accel_module 00:06:32.957 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:32.958 19:13:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.958 19:13:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:32.958 19:13:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:32.958 19:13:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:32.958 19:13:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.958 19:13:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.958 19:13:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:32.958 19:13:19 -- accel/accel.sh@40 -- # local IFS=, 00:06:32.958 19:13:19 -- accel/accel.sh@41 -- # jq -r . 00:06:32.958 [2024-04-24 19:13:19.758534] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:32.958 [2024-04-24 19:13:19.758596] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2897832 ] 00:06:32.958 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.958 [2024-04-24 19:13:19.829140] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.958 [2024-04-24 19:13:19.911231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=0x1 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=crc32c 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=32 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=software 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@22 -- # accel_module=software 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=32 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=32 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=1 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val=Yes 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:32.958 19:13:19 -- accel/accel.sh@20 -- # val= 00:06:32.958 19:13:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # IFS=: 00:06:32.958 19:13:19 -- accel/accel.sh@19 -- # read -r var val 00:06:34.331 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.331 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.331 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.331 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.331 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.331 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.331 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.331 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.332 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.332 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.332 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.332 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.332 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.332 19:13:21 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:34.332 19:13:21 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:06:34.332 19:13:21 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:34.332 00:06:34.332 real 0m1.404s 00:06:34.332 user 0m1.260s 00:06:34.332 sys 0m0.148s 00:06:34.332 19:13:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:34.332 19:13:21 -- common/autotest_common.sh@10 -- # set +x 00:06:34.332 ************************************ 00:06:34.332 END TEST accel_crc32c 00:06:34.332 ************************************ 00:06:34.332 19:13:21 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:34.332 19:13:21 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:34.332 19:13:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.332 19:13:21 -- common/autotest_common.sh@10 -- # set +x 00:06:34.332 ************************************ 00:06:34.332 START TEST accel_crc32c_C2 00:06:34.332 ************************************ 00:06:34.332 19:13:21 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:34.332 19:13:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:34.332 19:13:21 -- accel/accel.sh@17 -- # local accel_module 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.332 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.332 19:13:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:34.332 19:13:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:34.332 19:13:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.332 19:13:21 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:34.332 19:13:21 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:34.332 19:13:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.332 19:13:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.332 19:13:21 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:34.332 19:13:21 -- accel/accel.sh@40 -- # local IFS=, 00:06:34.332 19:13:21 -- accel/accel.sh@41 -- # jq -r . 00:06:34.590 [2024-04-24 19:13:21.370473] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:34.590 [2024-04-24 19:13:21.370538] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2898059 ] 00:06:34.590 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.590 [2024-04-24 19:13:21.445762] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.590 [2024-04-24 19:13:21.537501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=0x1 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=crc32c 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=0 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=software 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@22 -- # accel_module=software 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=32 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=32 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val=1 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.590 19:13:21 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:34.590 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.590 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.591 19:13:21 -- accel/accel.sh@20 -- # val=Yes 00:06:34.591 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.591 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.591 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:34.591 19:13:21 -- accel/accel.sh@20 -- # val= 00:06:34.591 19:13:21 -- accel/accel.sh@21 -- # case "$var" in 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # IFS=: 00:06:34.591 19:13:21 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@20 -- # val= 00:06:35.965 19:13:22 -- accel/accel.sh@21 -- # case "$var" in 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.965 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.965 19:13:22 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:35.965 19:13:22 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:06:35.966 19:13:22 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.966 00:06:35.966 real 0m1.417s 00:06:35.966 user 0m1.277s 00:06:35.966 sys 0m0.145s 00:06:35.966 19:13:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:35.966 19:13:22 -- common/autotest_common.sh@10 -- # set +x 00:06:35.966 ************************************ 00:06:35.966 END TEST accel_crc32c_C2 00:06:35.966 ************************************ 00:06:35.966 19:13:22 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:35.966 19:13:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:35.966 19:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.966 19:13:22 -- common/autotest_common.sh@10 -- # set +x 00:06:35.966 ************************************ 00:06:35.966 START TEST accel_copy 00:06:35.966 ************************************ 00:06:35.966 19:13:22 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:06:35.966 19:13:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:35.966 19:13:22 -- accel/accel.sh@17 -- # local accel_module 00:06:35.966 19:13:22 -- accel/accel.sh@19 -- # IFS=: 00:06:35.966 19:13:22 -- accel/accel.sh@19 -- # read -r var val 00:06:35.966 19:13:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:35.966 19:13:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:35.966 19:13:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.966 19:13:22 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:35.966 19:13:22 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:35.966 19:13:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.966 19:13:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.966 19:13:22 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:35.966 19:13:22 -- accel/accel.sh@40 -- # local IFS=, 00:06:35.966 19:13:22 -- accel/accel.sh@41 -- # jq -r . 00:06:35.966 [2024-04-24 19:13:22.960246] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:35.966 [2024-04-24 19:13:22.960309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2898271 ] 00:06:36.224 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.224 [2024-04-24 19:13:23.032971] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.224 [2024-04-24 19:13:23.115637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=0x1 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=copy 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@23 -- # accel_opc=copy 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=software 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@22 -- # accel_module=software 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=32 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=32 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=1 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val=Yes 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:36.224 19:13:23 -- accel/accel.sh@20 -- # val= 00:06:36.224 19:13:23 -- accel/accel.sh@21 -- # case "$var" in 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # IFS=: 00:06:36.224 19:13:23 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.599 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.599 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.599 19:13:24 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:37.599 19:13:24 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:06:37.599 19:13:24 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:37.599 00:06:37.599 real 0m1.398s 00:06:37.599 user 0m1.264s 00:06:37.599 sys 0m0.138s 00:06:37.599 19:13:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:37.599 19:13:24 -- common/autotest_common.sh@10 -- # set +x 00:06:37.599 ************************************ 00:06:37.599 END TEST accel_copy 00:06:37.599 ************************************ 00:06:37.599 19:13:24 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.600 19:13:24 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:37.600 19:13:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.600 19:13:24 -- common/autotest_common.sh@10 -- # set +x 00:06:37.600 ************************************ 00:06:37.600 START TEST accel_fill 00:06:37.600 ************************************ 00:06:37.600 19:13:24 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.600 19:13:24 -- accel/accel.sh@16 -- # local accel_opc 00:06:37.600 19:13:24 -- accel/accel.sh@17 -- # local accel_module 00:06:37.600 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.600 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.600 19:13:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.600 19:13:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:37.600 19:13:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.600 19:13:24 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:37.600 19:13:24 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:37.600 19:13:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.600 19:13:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.600 19:13:24 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:37.600 19:13:24 -- accel/accel.sh@40 -- # local IFS=, 00:06:37.600 19:13:24 -- accel/accel.sh@41 -- # jq -r . 00:06:37.600 [2024-04-24 19:13:24.577126] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:37.600 [2024-04-24 19:13:24.577190] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2898482 ] 00:06:37.600 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.858 [2024-04-24 19:13:24.652809] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.858 [2024-04-24 19:13:24.745133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=0x1 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=fill 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@23 -- # accel_opc=fill 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=0x80 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=software 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@22 -- # accel_module=software 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=64 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=64 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=1 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val=Yes 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:37.858 19:13:24 -- accel/accel.sh@20 -- # val= 00:06:37.858 19:13:24 -- accel/accel.sh@21 -- # case "$var" in 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # IFS=: 00:06:37.858 19:13:24 -- accel/accel.sh@19 -- # read -r var val 00:06:39.232 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.232 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.232 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.232 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.232 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.232 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.232 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.233 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.233 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.233 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:25 -- accel/accel.sh@20 -- # val= 00:06:39.233 19:13:25 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:25 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:25 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:39.233 19:13:25 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:06:39.233 19:13:25 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:39.233 00:06:39.233 real 0m1.424s 00:06:39.233 user 0m1.278s 00:06:39.233 sys 0m0.151s 00:06:39.233 19:13:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:39.233 19:13:25 -- common/autotest_common.sh@10 -- # set +x 00:06:39.233 ************************************ 00:06:39.233 END TEST accel_fill 00:06:39.233 ************************************ 00:06:39.233 19:13:26 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:39.233 19:13:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:39.233 19:13:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.233 19:13:26 -- common/autotest_common.sh@10 -- # set +x 00:06:39.233 ************************************ 00:06:39.233 START TEST accel_copy_crc32c 00:06:39.233 ************************************ 00:06:39.233 19:13:26 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:06:39.233 19:13:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:39.233 19:13:26 -- accel/accel.sh@17 -- # local accel_module 00:06:39.233 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.233 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.233 19:13:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:39.233 19:13:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:39.233 19:13:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.233 19:13:26 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:39.233 19:13:26 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:39.233 19:13:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.233 19:13:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.233 19:13:26 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:39.233 19:13:26 -- accel/accel.sh@40 -- # local IFS=, 00:06:39.233 19:13:26 -- accel/accel.sh@41 -- # jq -r . 00:06:39.233 [2024-04-24 19:13:26.172954] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:39.233 [2024-04-24 19:13:26.173007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2898696 ] 00:06:39.233 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.233 [2024-04-24 19:13:26.244696] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.491 [2024-04-24 19:13:26.330000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=0x1 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=copy_crc32c 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=0 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=software 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@22 -- # accel_module=software 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=32 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=32 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=1 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val=Yes 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:39.491 19:13:26 -- accel/accel.sh@20 -- # val= 00:06:39.491 19:13:26 -- accel/accel.sh@21 -- # case "$var" in 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # IFS=: 00:06:39.491 19:13:26 -- accel/accel.sh@19 -- # read -r var val 00:06:40.866 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.866 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.867 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.867 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.867 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.867 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:40.867 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:40.867 19:13:27 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:40.867 19:13:27 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:40.867 00:06:40.867 real 0m1.409s 00:06:40.867 user 0m1.261s 00:06:40.867 sys 0m0.151s 00:06:40.867 19:13:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:40.867 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:40.867 ************************************ 00:06:40.867 END TEST accel_copy_crc32c 00:06:40.867 ************************************ 00:06:40.867 19:13:27 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:40.867 19:13:27 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:40.867 19:13:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.867 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:40.867 ************************************ 00:06:40.867 START TEST accel_copy_crc32c_C2 00:06:40.867 ************************************ 00:06:40.867 19:13:27 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:40.867 19:13:27 -- accel/accel.sh@16 -- # local accel_opc 00:06:40.867 19:13:27 -- accel/accel.sh@17 -- # local accel_module 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:40.867 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:40.867 19:13:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:40.867 19:13:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:40.867 19:13:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.867 19:13:27 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:40.867 19:13:27 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:40.867 19:13:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.867 19:13:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.867 19:13:27 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:40.867 19:13:27 -- accel/accel.sh@40 -- # local IFS=, 00:06:40.867 19:13:27 -- accel/accel.sh@41 -- # jq -r . 00:06:40.867 [2024-04-24 19:13:27.752801] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:40.867 [2024-04-24 19:13:27.752875] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2898966 ] 00:06:40.867 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.867 [2024-04-24 19:13:27.825054] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.125 [2024-04-24 19:13:27.906944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val=0x1 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val=copy_crc32c 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val=0 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.125 19:13:27 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:41.125 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.125 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val='8192 bytes' 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val=software 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@22 -- # accel_module=software 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val=32 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val=32 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val=1 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val=Yes 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:41.126 19:13:27 -- accel/accel.sh@20 -- # val= 00:06:41.126 19:13:27 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # IFS=: 00:06:41.126 19:13:27 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.499 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:42.499 19:13:29 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:42.499 19:13:29 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:42.499 00:06:42.499 real 0m1.388s 00:06:42.499 user 0m1.260s 00:06:42.499 sys 0m0.131s 00:06:42.499 19:13:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:42.499 19:13:29 -- common/autotest_common.sh@10 -- # set +x 00:06:42.499 ************************************ 00:06:42.499 END TEST accel_copy_crc32c_C2 00:06:42.499 ************************************ 00:06:42.499 19:13:29 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:42.499 19:13:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:42.499 19:13:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.499 19:13:29 -- common/autotest_common.sh@10 -- # set +x 00:06:42.499 ************************************ 00:06:42.499 START TEST accel_dualcast 00:06:42.499 ************************************ 00:06:42.499 19:13:29 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:06:42.499 19:13:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:42.499 19:13:29 -- accel/accel.sh@17 -- # local accel_module 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.499 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.499 19:13:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:42.499 19:13:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.499 19:13:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:42.499 19:13:29 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:42.499 19:13:29 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:42.499 19:13:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.499 19:13:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.499 19:13:29 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:42.499 19:13:29 -- accel/accel.sh@40 -- # local IFS=, 00:06:42.499 19:13:29 -- accel/accel.sh@41 -- # jq -r . 00:06:42.499 [2024-04-24 19:13:29.320964] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:42.499 [2024-04-24 19:13:29.321017] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899281 ] 00:06:42.499 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.499 [2024-04-24 19:13:29.390846] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.499 [2024-04-24 19:13:29.475057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val=0x1 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val=dualcast 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val=software 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.757 19:13:29 -- accel/accel.sh@22 -- # accel_module=software 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.757 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.757 19:13:29 -- accel/accel.sh@20 -- # val=32 00:06:42.757 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val=32 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val=1 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val=Yes 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:42.758 19:13:29 -- accel/accel.sh@20 -- # val= 00:06:42.758 19:13:29 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # IFS=: 00:06:42.758 19:13:29 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@20 -- # val= 00:06:43.691 19:13:30 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.691 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.691 19:13:30 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:43.691 19:13:30 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:06:43.691 19:13:30 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:43.691 00:06:43.692 real 0m1.408s 00:06:43.692 user 0m1.269s 00:06:43.692 sys 0m0.140s 00:06:43.692 19:13:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:43.692 19:13:30 -- common/autotest_common.sh@10 -- # set +x 00:06:43.692 ************************************ 00:06:43.692 END TEST accel_dualcast 00:06:43.692 ************************************ 00:06:43.951 19:13:30 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:43.951 19:13:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:43.951 19:13:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.951 19:13:30 -- common/autotest_common.sh@10 -- # set +x 00:06:43.951 ************************************ 00:06:43.951 START TEST accel_compare 00:06:43.951 ************************************ 00:06:43.951 19:13:30 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:06:43.951 19:13:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:43.951 19:13:30 -- accel/accel.sh@17 -- # local accel_module 00:06:43.951 19:13:30 -- accel/accel.sh@19 -- # IFS=: 00:06:43.951 19:13:30 -- accel/accel.sh@19 -- # read -r var val 00:06:43.951 19:13:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:43.951 19:13:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:43.951 19:13:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.951 19:13:30 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:43.951 19:13:30 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:43.951 19:13:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.951 19:13:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.951 19:13:30 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:43.951 19:13:30 -- accel/accel.sh@40 -- # local IFS=, 00:06:43.951 19:13:30 -- accel/accel.sh@41 -- # jq -r . 00:06:43.951 [2024-04-24 19:13:30.948252] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:43.951 [2024-04-24 19:13:30.948313] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899487 ] 00:06:44.210 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.210 [2024-04-24 19:13:31.023259] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.210 [2024-04-24 19:13:31.113450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=0x1 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=compare 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@23 -- # accel_opc=compare 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=software 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@22 -- # accel_module=software 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=32 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=32 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=1 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val=Yes 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:44.210 19:13:31 -- accel/accel.sh@20 -- # val= 00:06:44.210 19:13:31 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # IFS=: 00:06:44.210 19:13:31 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.583 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:45.583 19:13:32 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:06:45.583 19:13:32 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:45.583 00:06:45.583 real 0m1.418s 00:06:45.583 user 0m1.270s 00:06:45.583 sys 0m0.150s 00:06:45.583 19:13:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:45.583 19:13:32 -- common/autotest_common.sh@10 -- # set +x 00:06:45.583 ************************************ 00:06:45.583 END TEST accel_compare 00:06:45.583 ************************************ 00:06:45.583 19:13:32 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:45.583 19:13:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:45.583 19:13:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.583 19:13:32 -- common/autotest_common.sh@10 -- # set +x 00:06:45.583 ************************************ 00:06:45.583 START TEST accel_xor 00:06:45.583 ************************************ 00:06:45.583 19:13:32 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:06:45.583 19:13:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:45.583 19:13:32 -- accel/accel.sh@17 -- # local accel_module 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.583 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.583 19:13:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:45.583 19:13:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:45.583 19:13:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.583 19:13:32 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:45.583 19:13:32 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:45.583 19:13:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.583 19:13:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.583 19:13:32 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:45.583 19:13:32 -- accel/accel.sh@40 -- # local IFS=, 00:06:45.583 19:13:32 -- accel/accel.sh@41 -- # jq -r . 00:06:45.583 [2024-04-24 19:13:32.558002] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:45.583 [2024-04-24 19:13:32.558066] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899705 ] 00:06:45.583 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.842 [2024-04-24 19:13:32.630172] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.842 [2024-04-24 19:13:32.716176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=0x1 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=xor 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=2 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=software 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@22 -- # accel_module=software 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=32 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=32 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=1 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val=Yes 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:45.842 19:13:32 -- accel/accel.sh@20 -- # val= 00:06:45.842 19:13:32 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # IFS=: 00:06:45.842 19:13:32 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@20 -- # val= 00:06:47.217 19:13:33 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:33 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:33 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:47.217 19:13:33 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:47.217 19:13:33 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.217 00:06:47.217 real 0m1.406s 00:06:47.217 user 0m1.268s 00:06:47.217 sys 0m0.140s 00:06:47.217 19:13:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:47.217 19:13:33 -- common/autotest_common.sh@10 -- # set +x 00:06:47.217 ************************************ 00:06:47.217 END TEST accel_xor 00:06:47.217 ************************************ 00:06:47.217 19:13:33 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:47.217 19:13:33 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:47.217 19:13:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.217 19:13:33 -- common/autotest_common.sh@10 -- # set +x 00:06:47.217 ************************************ 00:06:47.217 START TEST accel_xor 00:06:47.217 ************************************ 00:06:47.217 19:13:34 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:06:47.217 19:13:34 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.217 19:13:34 -- accel/accel.sh@17 -- # local accel_module 00:06:47.217 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.217 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.217 19:13:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:47.217 19:13:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:47.217 19:13:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.217 19:13:34 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:47.217 19:13:34 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:47.217 19:13:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.217 19:13:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.217 19:13:34 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:47.217 19:13:34 -- accel/accel.sh@40 -- # local IFS=, 00:06:47.217 19:13:34 -- accel/accel.sh@41 -- # jq -r . 00:06:47.217 [2024-04-24 19:13:34.178965] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:47.217 [2024-04-24 19:13:34.179027] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2899911 ] 00:06:47.217 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.476 [2024-04-24 19:13:34.253455] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.476 [2024-04-24 19:13:34.343515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=0x1 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=xor 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=3 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=software 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@22 -- # accel_module=software 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=32 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=32 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=1 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val=Yes 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:47.476 19:13:34 -- accel/accel.sh@20 -- # val= 00:06:47.476 19:13:34 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # IFS=: 00:06:47.476 19:13:34 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:48.850 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:48.850 19:13:35 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:48.850 19:13:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:48.850 00:06:48.850 real 0m1.419s 00:06:48.850 user 0m1.277s 00:06:48.850 sys 0m0.144s 00:06:48.850 19:13:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:48.850 19:13:35 -- common/autotest_common.sh@10 -- # set +x 00:06:48.850 ************************************ 00:06:48.850 END TEST accel_xor 00:06:48.850 ************************************ 00:06:48.850 19:13:35 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:48.850 19:13:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:48.850 19:13:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.850 19:13:35 -- common/autotest_common.sh@10 -- # set +x 00:06:48.850 ************************************ 00:06:48.850 START TEST accel_dif_verify 00:06:48.850 ************************************ 00:06:48.850 19:13:35 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:06:48.850 19:13:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:48.850 19:13:35 -- accel/accel.sh@17 -- # local accel_module 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:48.850 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:48.850 19:13:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:48.850 19:13:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:48.850 19:13:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.850 19:13:35 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:48.850 19:13:35 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:48.850 19:13:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.850 19:13:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.850 19:13:35 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:48.850 19:13:35 -- accel/accel.sh@40 -- # local IFS=, 00:06:48.850 19:13:35 -- accel/accel.sh@41 -- # jq -r . 00:06:48.850 [2024-04-24 19:13:35.767793] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:48.850 [2024-04-24 19:13:35.767841] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2900128 ] 00:06:48.850 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.850 [2024-04-24 19:13:35.835633] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.159 [2024-04-24 19:13:35.920619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=0x1 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=dif_verify 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=software 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@22 -- # accel_module=software 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=32 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=32 00:06:49.159 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.159 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.159 19:13:35 -- accel/accel.sh@20 -- # val=1 00:06:49.160 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.160 19:13:35 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:49.160 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.160 19:13:35 -- accel/accel.sh@20 -- # val=No 00:06:49.160 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.160 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.160 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:49.160 19:13:35 -- accel/accel.sh@20 -- # val= 00:06:49.160 19:13:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # IFS=: 00:06:49.160 19:13:35 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.548 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.548 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.548 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:50.549 19:13:37 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:06:50.549 19:13:37 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.549 00:06:50.549 real 0m1.394s 00:06:50.549 user 0m1.269s 00:06:50.549 sys 0m0.128s 00:06:50.549 19:13:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:50.549 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:06:50.549 ************************************ 00:06:50.549 END TEST accel_dif_verify 00:06:50.549 ************************************ 00:06:50.549 19:13:37 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:50.549 19:13:37 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:50.549 19:13:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.549 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:06:50.549 ************************************ 00:06:50.549 START TEST accel_dif_generate 00:06:50.549 ************************************ 00:06:50.549 19:13:37 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:06:50.549 19:13:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.549 19:13:37 -- accel/accel.sh@17 -- # local accel_module 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:50.549 19:13:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.549 19:13:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:50.549 19:13:37 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:50.549 19:13:37 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:50.549 19:13:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.549 19:13:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.549 19:13:37 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:50.549 19:13:37 -- accel/accel.sh@40 -- # local IFS=, 00:06:50.549 19:13:37 -- accel/accel.sh@41 -- # jq -r . 00:06:50.549 [2024-04-24 19:13:37.357191] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:50.549 [2024-04-24 19:13:37.357247] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2900415 ] 00:06:50.549 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.549 [2024-04-24 19:13:37.428940] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.549 [2024-04-24 19:13:37.512711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=0x1 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=dif_generate 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=software 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@22 -- # accel_module=software 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=32 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=32 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=1 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val=No 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:50.549 19:13:37 -- accel/accel.sh@20 -- # val= 00:06:50.549 19:13:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # IFS=: 00:06:50.549 19:13:37 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@20 -- # val= 00:06:51.947 19:13:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:51.947 19:13:38 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:06:51.947 19:13:38 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:51.947 00:06:51.947 real 0m1.409s 00:06:51.947 user 0m1.271s 00:06:51.947 sys 0m0.140s 00:06:51.947 19:13:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:51.947 19:13:38 -- common/autotest_common.sh@10 -- # set +x 00:06:51.947 ************************************ 00:06:51.947 END TEST accel_dif_generate 00:06:51.947 ************************************ 00:06:51.947 19:13:38 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:51.947 19:13:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:51.947 19:13:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.947 19:13:38 -- common/autotest_common.sh@10 -- # set +x 00:06:51.947 ************************************ 00:06:51.947 START TEST accel_dif_generate_copy 00:06:51.947 ************************************ 00:06:51.947 19:13:38 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:06:51.947 19:13:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:51.947 19:13:38 -- accel/accel.sh@17 -- # local accel_module 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # IFS=: 00:06:51.947 19:13:38 -- accel/accel.sh@19 -- # read -r var val 00:06:51.947 19:13:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:51.947 19:13:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:51.947 19:13:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.947 19:13:38 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:51.947 19:13:38 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:51.947 19:13:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.947 19:13:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.947 19:13:38 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:51.947 19:13:38 -- accel/accel.sh@40 -- # local IFS=, 00:06:51.947 19:13:38 -- accel/accel.sh@41 -- # jq -r . 00:06:51.948 [2024-04-24 19:13:38.929364] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:51.948 [2024-04-24 19:13:38.929442] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2900712 ] 00:06:51.948 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.206 [2024-04-24 19:13:39.001354] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.206 [2024-04-24 19:13:39.082955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=0x1 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=software 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@22 -- # accel_module=software 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=32 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=32 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=1 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val=No 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:52.206 19:13:39 -- accel/accel.sh@20 -- # val= 00:06:52.206 19:13:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # IFS=: 00:06:52.206 19:13:39 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.581 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:53.581 19:13:40 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:06:53.581 19:13:40 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.581 00:06:53.581 real 0m1.400s 00:06:53.581 user 0m1.263s 00:06:53.581 sys 0m0.142s 00:06:53.581 19:13:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:53.581 19:13:40 -- common/autotest_common.sh@10 -- # set +x 00:06:53.581 ************************************ 00:06:53.581 END TEST accel_dif_generate_copy 00:06:53.581 ************************************ 00:06:53.581 19:13:40 -- accel/accel.sh@115 -- # [[ y == y ]] 00:06:53.581 19:13:40 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:53.581 19:13:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:53.581 19:13:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.581 19:13:40 -- common/autotest_common.sh@10 -- # set +x 00:06:53.581 ************************************ 00:06:53.581 START TEST accel_comp 00:06:53.581 ************************************ 00:06:53.581 19:13:40 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:53.581 19:13:40 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.581 19:13:40 -- accel/accel.sh@17 -- # local accel_module 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.581 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.581 19:13:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:53.581 19:13:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:53.581 19:13:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.581 19:13:40 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:53.581 19:13:40 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:53.581 19:13:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.581 19:13:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.581 19:13:40 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:53.581 19:13:40 -- accel/accel.sh@40 -- # local IFS=, 00:06:53.581 19:13:40 -- accel/accel.sh@41 -- # jq -r . 00:06:53.581 [2024-04-24 19:13:40.544021] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:53.581 [2024-04-24 19:13:40.544088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2900923 ] 00:06:53.581 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.839 [2024-04-24 19:13:40.618708] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.840 [2024-04-24 19:13:40.710749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=0x1 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=compress 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@23 -- # accel_opc=compress 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=software 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@22 -- # accel_module=software 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=32 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=32 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=1 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val=No 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:53.840 19:13:40 -- accel/accel.sh@20 -- # val= 00:06:53.840 19:13:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # IFS=: 00:06:53.840 19:13:40 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@20 -- # val= 00:06:55.213 19:13:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:41 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:41 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:55.213 19:13:41 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:06:55.213 19:13:41 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.213 00:06:55.213 real 0m1.425s 00:06:55.213 user 0m1.293s 00:06:55.213 sys 0m0.138s 00:06:55.213 19:13:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:55.213 19:13:41 -- common/autotest_common.sh@10 -- # set +x 00:06:55.213 ************************************ 00:06:55.213 END TEST accel_comp 00:06:55.213 ************************************ 00:06:55.213 19:13:41 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:55.213 19:13:41 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:55.213 19:13:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.213 19:13:41 -- common/autotest_common.sh@10 -- # set +x 00:06:55.213 ************************************ 00:06:55.213 START TEST accel_decomp 00:06:55.213 ************************************ 00:06:55.213 19:13:42 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:55.213 19:13:42 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.213 19:13:42 -- accel/accel.sh@17 -- # local accel_module 00:06:55.213 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.213 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.213 19:13:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:55.213 19:13:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:55.213 19:13:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.213 19:13:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:55.213 19:13:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:55.213 19:13:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.213 19:13:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.213 19:13:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:55.213 19:13:42 -- accel/accel.sh@40 -- # local IFS=, 00:06:55.213 19:13:42 -- accel/accel.sh@41 -- # jq -r . 00:06:55.213 [2024-04-24 19:13:42.151916] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:55.213 [2024-04-24 19:13:42.151982] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2901132 ] 00:06:55.213 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.213 [2024-04-24 19:13:42.225526] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.472 [2024-04-24 19:13:42.310334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val=0x1 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val=decompress 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.472 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.472 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.472 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=software 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@22 -- # accel_module=software 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=32 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=32 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=1 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val=Yes 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:55.473 19:13:42 -- accel/accel.sh@20 -- # val= 00:06:55.473 19:13:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # IFS=: 00:06:55.473 19:13:42 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:56.845 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:56.845 19:13:43 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:56.845 19:13:43 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.845 00:06:56.845 real 0m1.412s 00:06:56.845 user 0m1.270s 00:06:56.845 sys 0m0.146s 00:06:56.845 19:13:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.845 19:13:43 -- common/autotest_common.sh@10 -- # set +x 00:06:56.845 ************************************ 00:06:56.845 END TEST accel_decomp 00:06:56.845 ************************************ 00:06:56.845 19:13:43 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:56.845 19:13:43 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:56.845 19:13:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.845 19:13:43 -- common/autotest_common.sh@10 -- # set +x 00:06:56.845 ************************************ 00:06:56.845 START TEST accel_decmop_full 00:06:56.845 ************************************ 00:06:56.845 19:13:43 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:56.845 19:13:43 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.845 19:13:43 -- accel/accel.sh@17 -- # local accel_module 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:56.845 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:56.845 19:13:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:56.845 19:13:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.845 19:13:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:56.845 19:13:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:56.845 19:13:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:56.845 19:13:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.845 19:13:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.845 19:13:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:56.845 19:13:43 -- accel/accel.sh@40 -- # local IFS=, 00:06:56.845 19:13:43 -- accel/accel.sh@41 -- # jq -r . 00:06:56.845 [2024-04-24 19:13:43.730419] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:56.845 [2024-04-24 19:13:43.730473] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2901346 ] 00:06:56.845 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.845 [2024-04-24 19:13:43.800917] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.104 [2024-04-24 19:13:43.881179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val=0x1 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val=decompress 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val=software 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@22 -- # accel_module=software 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:57.104 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.104 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.104 19:13:43 -- accel/accel.sh@20 -- # val=32 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val=32 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val=1 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val=Yes 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:57.105 19:13:43 -- accel/accel.sh@20 -- # val= 00:06:57.105 19:13:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # IFS=: 00:06:57.105 19:13:43 -- accel/accel.sh@19 -- # read -r var val 00:06:58.484 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.484 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.484 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.484 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.484 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.484 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.484 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.484 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.484 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.484 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.484 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:58.485 19:13:45 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:58.485 19:13:45 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.485 00:06:58.485 real 0m1.397s 00:06:58.485 user 0m1.261s 00:06:58.485 sys 0m0.140s 00:06:58.485 19:13:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:58.485 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:06:58.485 ************************************ 00:06:58.485 END TEST accel_decmop_full 00:06:58.485 ************************************ 00:06:58.485 19:13:45 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:58.485 19:13:45 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:58.485 19:13:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.485 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:06:58.485 ************************************ 00:06:58.485 START TEST accel_decomp_mcore 00:06:58.485 ************************************ 00:06:58.485 19:13:45 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:58.485 19:13:45 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.485 19:13:45 -- accel/accel.sh@17 -- # local accel_module 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:58.485 19:13:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:58.485 19:13:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.485 19:13:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:58.485 19:13:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:58.485 19:13:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.485 19:13:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.485 19:13:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:58.485 19:13:45 -- accel/accel.sh@40 -- # local IFS=, 00:06:58.485 19:13:45 -- accel/accel.sh@41 -- # jq -r . 00:06:58.485 [2024-04-24 19:13:45.286546] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:58.485 [2024-04-24 19:13:45.286605] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2901555 ] 00:06:58.485 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.485 [2024-04-24 19:13:45.357306] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:58.485 [2024-04-24 19:13:45.442907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:58.485 [2024-04-24 19:13:45.442995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:58.485 [2024-04-24 19:13:45.443072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:58.485 [2024-04-24 19:13:45.443090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val=0xf 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val=decompress 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.485 19:13:45 -- accel/accel.sh@20 -- # val=software 00:06:58.485 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.485 19:13:45 -- accel/accel.sh@22 -- # accel_module=software 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.485 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val=32 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val=32 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val=1 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val=Yes 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:58.744 19:13:45 -- accel/accel.sh@20 -- # val= 00:06:58.744 19:13:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # IFS=: 00:06:58.744 19:13:45 -- accel/accel.sh@19 -- # read -r var val 00:06:59.683 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.683 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.683 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.683 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.683 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.683 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.683 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.683 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@20 -- # val= 00:06:59.684 19:13:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.684 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.684 19:13:46 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:59.684 19:13:46 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:59.684 19:13:46 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.684 00:06:59.684 real 0m1.419s 00:06:59.684 user 0m4.669s 00:06:59.684 sys 0m0.145s 00:06:59.684 19:13:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:59.684 19:13:46 -- common/autotest_common.sh@10 -- # set +x 00:06:59.684 ************************************ 00:06:59.684 END TEST accel_decomp_mcore 00:06:59.684 ************************************ 00:06:59.944 19:13:46 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:59.944 19:13:46 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:59.944 19:13:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.944 19:13:46 -- common/autotest_common.sh@10 -- # set +x 00:06:59.944 ************************************ 00:06:59.944 START TEST accel_decomp_full_mcore 00:06:59.944 ************************************ 00:06:59.944 19:13:46 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:59.944 19:13:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.944 19:13:46 -- accel/accel.sh@17 -- # local accel_module 00:06:59.944 19:13:46 -- accel/accel.sh@19 -- # IFS=: 00:06:59.944 19:13:46 -- accel/accel.sh@19 -- # read -r var val 00:06:59.944 19:13:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:59.944 19:13:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.944 19:13:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:59.944 19:13:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:59.944 19:13:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:59.944 19:13:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.944 19:13:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.944 19:13:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:59.944 19:13:46 -- accel/accel.sh@40 -- # local IFS=, 00:06:59.944 19:13:46 -- accel/accel.sh@41 -- # jq -r . 00:06:59.944 [2024-04-24 19:13:46.914946] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:06:59.944 [2024-04-24 19:13:46.915023] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2901847 ] 00:06:59.944 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.203 [2024-04-24 19:13:46.987667] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:00.203 [2024-04-24 19:13:47.075188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:00.203 [2024-04-24 19:13:47.075210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:00.203 [2024-04-24 19:13:47.075288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:00.203 [2024-04-24 19:13:47.075289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=0xf 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=decompress 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=software 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@22 -- # accel_module=software 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=32 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=32 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=1 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val=Yes 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.203 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.203 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.203 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.204 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.204 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:00.204 19:13:47 -- accel/accel.sh@20 -- # val= 00:07:00.204 19:13:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:00.204 19:13:47 -- accel/accel.sh@19 -- # IFS=: 00:07:00.204 19:13:47 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.577 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:01.577 19:13:48 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:01.577 19:13:48 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.577 00:07:01.577 real 0m1.441s 00:07:01.577 user 0m4.705s 00:07:01.577 sys 0m0.157s 00:07:01.577 19:13:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:01.577 19:13:48 -- common/autotest_common.sh@10 -- # set +x 00:07:01.577 ************************************ 00:07:01.577 END TEST accel_decomp_full_mcore 00:07:01.577 ************************************ 00:07:01.577 19:13:48 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:01.577 19:13:48 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:01.577 19:13:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.577 19:13:48 -- common/autotest_common.sh@10 -- # set +x 00:07:01.577 ************************************ 00:07:01.577 START TEST accel_decomp_mthread 00:07:01.577 ************************************ 00:07:01.577 19:13:48 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:01.577 19:13:48 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.577 19:13:48 -- accel/accel.sh@17 -- # local accel_module 00:07:01.577 19:13:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.577 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.577 19:13:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:01.577 19:13:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.577 19:13:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:01.577 19:13:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:01.577 19:13:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.577 19:13:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.577 19:13:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:01.577 19:13:48 -- accel/accel.sh@40 -- # local IFS=, 00:07:01.577 19:13:48 -- accel/accel.sh@41 -- # jq -r . 00:07:01.577 [2024-04-24 19:13:48.529090] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:01.577 [2024-04-24 19:13:48.529151] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2902142 ] 00:07:01.577 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.577 [2024-04-24 19:13:48.592645] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.835 [2024-04-24 19:13:48.676565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.835 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.835 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.835 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=0x1 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=decompress 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=software 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@22 -- # accel_module=software 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=32 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=32 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=2 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val=Yes 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:01.836 19:13:48 -- accel/accel.sh@20 -- # val= 00:07:01.836 19:13:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # IFS=: 00:07:01.836 19:13:48 -- accel/accel.sh@19 -- # read -r var val 00:07:03.209 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.209 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.209 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.209 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.209 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.209 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.209 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.209 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.209 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.209 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.209 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.210 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.210 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.210 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:49 -- accel/accel.sh@20 -- # val= 00:07:03.210 19:13:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:49 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:03.210 19:13:49 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:03.210 19:13:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:03.210 00:07:03.210 real 0m1.396s 00:07:03.210 user 0m1.282s 00:07:03.210 sys 0m0.127s 00:07:03.210 19:13:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:03.210 19:13:49 -- common/autotest_common.sh@10 -- # set +x 00:07:03.210 ************************************ 00:07:03.210 END TEST accel_decomp_mthread 00:07:03.210 ************************************ 00:07:03.210 19:13:49 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:03.210 19:13:49 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:03.210 19:13:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.210 19:13:49 -- common/autotest_common.sh@10 -- # set +x 00:07:03.210 ************************************ 00:07:03.210 START TEST accel_deomp_full_mthread 00:07:03.210 ************************************ 00:07:03.210 19:13:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:03.210 19:13:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:03.210 19:13:50 -- accel/accel.sh@17 -- # local accel_module 00:07:03.210 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.210 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.210 19:13:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:03.210 19:13:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.210 19:13:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:03.210 19:13:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:03.210 19:13:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:03.210 19:13:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.210 19:13:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.210 19:13:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:03.210 19:13:50 -- accel/accel.sh@40 -- # local IFS=, 00:07:03.210 19:13:50 -- accel/accel.sh@41 -- # jq -r . 00:07:03.210 [2024-04-24 19:13:50.096352] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:03.210 [2024-04-24 19:13:50.096409] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2902356 ] 00:07:03.210 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.210 [2024-04-24 19:13:50.166813] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.468 [2024-04-24 19:13:50.251658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=0x1 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=decompress 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=software 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@22 -- # accel_module=software 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=32 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=32 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=2 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val=Yes 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:03.468 19:13:50 -- accel/accel.sh@20 -- # val= 00:07:03.468 19:13:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # IFS=: 00:07:03.468 19:13:50 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@20 -- # val= 00:07:04.843 19:13:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # IFS=: 00:07:04.843 19:13:51 -- accel/accel.sh@19 -- # read -r var val 00:07:04.843 19:13:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:04.843 19:13:51 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:04.843 19:13:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.843 00:07:04.843 real 0m1.429s 00:07:04.843 user 0m1.303s 00:07:04.843 sys 0m0.140s 00:07:04.843 19:13:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.843 19:13:51 -- common/autotest_common.sh@10 -- # set +x 00:07:04.843 ************************************ 00:07:04.843 END TEST accel_deomp_full_mthread 00:07:04.843 ************************************ 00:07:04.843 19:13:51 -- accel/accel.sh@124 -- # [[ n == y ]] 00:07:04.843 19:13:51 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:04.843 19:13:51 -- accel/accel.sh@137 -- # build_accel_config 00:07:04.843 19:13:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.843 19:13:51 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:04.843 19:13:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.843 19:13:51 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:04.843 19:13:51 -- common/autotest_common.sh@10 -- # set +x 00:07:04.843 19:13:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.843 19:13:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.843 19:13:51 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:04.843 19:13:51 -- accel/accel.sh@40 -- # local IFS=, 00:07:04.843 19:13:51 -- accel/accel.sh@41 -- # jq -r . 00:07:04.843 ************************************ 00:07:04.843 START TEST accel_dif_functional_tests 00:07:04.843 ************************************ 00:07:04.843 19:13:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:04.843 [2024-04-24 19:13:51.717188] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:04.843 [2024-04-24 19:13:51.717229] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2902572 ] 00:07:04.843 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.843 [2024-04-24 19:13:51.786742] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:05.101 [2024-04-24 19:13:51.872216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.101 [2024-04-24 19:13:51.872303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.101 [2024-04-24 19:13:51.872306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.101 00:07:05.101 00:07:05.101 CUnit - A unit testing framework for C - Version 2.1-3 00:07:05.101 http://cunit.sourceforge.net/ 00:07:05.101 00:07:05.101 00:07:05.101 Suite: accel_dif 00:07:05.101 Test: verify: DIF generated, GUARD check ...passed 00:07:05.101 Test: verify: DIF generated, APPTAG check ...passed 00:07:05.101 Test: verify: DIF generated, REFTAG check ...passed 00:07:05.101 Test: verify: DIF not generated, GUARD check ...[2024-04-24 19:13:51.951433] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:05.101 [2024-04-24 19:13:51.951481] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:05.101 passed 00:07:05.101 Test: verify: DIF not generated, APPTAG check ...[2024-04-24 19:13:51.951528] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:05.101 [2024-04-24 19:13:51.951545] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:05.101 passed 00:07:05.101 Test: verify: DIF not generated, REFTAG check ...[2024-04-24 19:13:51.951568] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:05.101 [2024-04-24 19:13:51.951586] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:05.101 passed 00:07:05.101 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:05.101 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-24 19:13:51.951631] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:05.101 passed 00:07:05.101 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:05.101 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:05.101 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:05.101 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-24 19:13:51.951742] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:05.101 passed 00:07:05.101 Test: generate copy: DIF generated, GUARD check ...passed 00:07:05.101 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:05.101 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:05.102 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:05.102 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:05.102 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:05.102 Test: generate copy: iovecs-len validate ...[2024-04-24 19:13:51.951916] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:05.102 passed 00:07:05.102 Test: generate copy: buffer alignment validate ...passed 00:07:05.102 00:07:05.102 Run Summary: Type Total Ran Passed Failed Inactive 00:07:05.102 suites 1 1 n/a 0 0 00:07:05.102 tests 20 20 20 0 0 00:07:05.102 asserts 204 204 204 0 n/a 00:07:05.102 00:07:05.102 Elapsed time = 0.002 seconds 00:07:05.360 00:07:05.360 real 0m0.490s 00:07:05.360 user 0m0.688s 00:07:05.360 sys 0m0.170s 00:07:05.360 19:13:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.360 19:13:52 -- common/autotest_common.sh@10 -- # set +x 00:07:05.360 ************************************ 00:07:05.360 END TEST accel_dif_functional_tests 00:07:05.360 ************************************ 00:07:05.360 00:07:05.360 real 0m35.837s 00:07:05.360 user 0m36.871s 00:07:05.360 sys 0m6.490s 00:07:05.360 19:13:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.360 19:13:52 -- common/autotest_common.sh@10 -- # set +x 00:07:05.360 ************************************ 00:07:05.360 END TEST accel 00:07:05.360 ************************************ 00:07:05.360 19:13:52 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:05.360 19:13:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:05.360 19:13:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.360 19:13:52 -- common/autotest_common.sh@10 -- # set +x 00:07:05.618 ************************************ 00:07:05.618 START TEST accel_rpc 00:07:05.618 ************************************ 00:07:05.618 19:13:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:05.618 * Looking for test storage... 00:07:05.618 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:07:05.618 19:13:52 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:05.618 19:13:52 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2902808 00:07:05.618 19:13:52 -- accel/accel_rpc.sh@15 -- # waitforlisten 2902808 00:07:05.618 19:13:52 -- common/autotest_common.sh@817 -- # '[' -z 2902808 ']' 00:07:05.619 19:13:52 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:05.619 19:13:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.619 19:13:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:05.619 19:13:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.619 19:13:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:05.619 19:13:52 -- common/autotest_common.sh@10 -- # set +x 00:07:05.619 [2024-04-24 19:13:52.569076] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:05.619 [2024-04-24 19:13:52.569127] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2902808 ] 00:07:05.619 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.619 [2024-04-24 19:13:52.638772] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.877 [2024-04-24 19:13:52.727413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.443 19:13:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:06.443 19:13:53 -- common/autotest_common.sh@850 -- # return 0 00:07:06.443 19:13:53 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:06.443 19:13:53 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:06.443 19:13:53 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:06.443 19:13:53 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:06.443 19:13:53 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:06.443 19:13:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:06.443 19:13:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.443 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.700 ************************************ 00:07:06.700 START TEST accel_assign_opcode 00:07:06.700 ************************************ 00:07:06.700 19:13:53 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:07:06.700 19:13:53 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:06.700 19:13:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:06.700 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.700 [2024-04-24 19:13:53.509730] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:06.700 19:13:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:06.700 19:13:53 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:06.700 19:13:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:06.700 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.700 [2024-04-24 19:13:53.517736] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:06.700 19:13:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:06.700 19:13:53 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:06.700 19:13:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:06.700 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.958 19:13:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:06.958 19:13:53 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:06.958 19:13:53 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:06.958 19:13:53 -- accel/accel_rpc.sh@42 -- # grep software 00:07:06.958 19:13:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:06.958 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.958 19:13:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:06.958 software 00:07:06.958 00:07:06.958 real 0m0.257s 00:07:06.958 user 0m0.042s 00:07:06.958 sys 0m0.012s 00:07:06.958 19:13:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:06.958 19:13:53 -- common/autotest_common.sh@10 -- # set +x 00:07:06.958 ************************************ 00:07:06.958 END TEST accel_assign_opcode 00:07:06.958 ************************************ 00:07:06.958 19:13:53 -- accel/accel_rpc.sh@55 -- # killprocess 2902808 00:07:06.958 19:13:53 -- common/autotest_common.sh@936 -- # '[' -z 2902808 ']' 00:07:06.958 19:13:53 -- common/autotest_common.sh@940 -- # kill -0 2902808 00:07:06.958 19:13:53 -- common/autotest_common.sh@941 -- # uname 00:07:06.958 19:13:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:06.958 19:13:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2902808 00:07:06.958 19:13:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:06.958 19:13:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:06.958 19:13:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2902808' 00:07:06.958 killing process with pid 2902808 00:07:06.958 19:13:53 -- common/autotest_common.sh@955 -- # kill 2902808 00:07:06.958 19:13:53 -- common/autotest_common.sh@960 -- # wait 2902808 00:07:07.216 00:07:07.216 real 0m1.797s 00:07:07.216 user 0m1.823s 00:07:07.216 sys 0m0.544s 00:07:07.216 19:13:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:07.216 19:13:54 -- common/autotest_common.sh@10 -- # set +x 00:07:07.216 ************************************ 00:07:07.216 END TEST accel_rpc 00:07:07.216 ************************************ 00:07:07.474 19:13:54 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:07.474 19:13:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:07.474 19:13:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.474 19:13:54 -- common/autotest_common.sh@10 -- # set +x 00:07:07.474 ************************************ 00:07:07.474 START TEST app_cmdline 00:07:07.474 ************************************ 00:07:07.474 19:13:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:07.474 * Looking for test storage... 00:07:07.733 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:07.733 19:13:54 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:07.733 19:13:54 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2903086 00:07:07.733 19:13:54 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:07.733 19:13:54 -- app/cmdline.sh@18 -- # waitforlisten 2903086 00:07:07.733 19:13:54 -- common/autotest_common.sh@817 -- # '[' -z 2903086 ']' 00:07:07.733 19:13:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:07.733 19:13:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:07.733 19:13:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:07.733 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:07.733 19:13:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:07.733 19:13:54 -- common/autotest_common.sh@10 -- # set +x 00:07:07.733 [2024-04-24 19:13:54.549949] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:07.733 [2024-04-24 19:13:54.550013] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2903086 ] 00:07:07.733 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.733 [2024-04-24 19:13:54.620920] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.733 [2024-04-24 19:13:54.700478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.667 19:13:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:08.667 19:13:55 -- common/autotest_common.sh@850 -- # return 0 00:07:08.667 19:13:55 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:08.667 { 00:07:08.667 "version": "SPDK v24.05-pre git sha1 5c8d451f1", 00:07:08.667 "fields": { 00:07:08.667 "major": 24, 00:07:08.667 "minor": 5, 00:07:08.667 "patch": 0, 00:07:08.667 "suffix": "-pre", 00:07:08.667 "commit": "5c8d451f1" 00:07:08.667 } 00:07:08.667 } 00:07:08.667 19:13:55 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:08.667 19:13:55 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:08.667 19:13:55 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:08.667 19:13:55 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:08.667 19:13:55 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:08.667 19:13:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:08.667 19:13:55 -- common/autotest_common.sh@10 -- # set +x 00:07:08.667 19:13:55 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:08.667 19:13:55 -- app/cmdline.sh@26 -- # sort 00:07:08.667 19:13:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:08.667 19:13:55 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:08.667 19:13:55 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:08.667 19:13:55 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:08.667 19:13:55 -- common/autotest_common.sh@638 -- # local es=0 00:07:08.667 19:13:55 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:08.667 19:13:55 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:08.667 19:13:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:08.667 19:13:55 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:08.667 19:13:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:08.667 19:13:55 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:08.667 19:13:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:08.667 19:13:55 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:08.667 19:13:55 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:07:08.667 19:13:55 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:08.926 request: 00:07:08.926 { 00:07:08.926 "method": "env_dpdk_get_mem_stats", 00:07:08.926 "req_id": 1 00:07:08.926 } 00:07:08.926 Got JSON-RPC error response 00:07:08.926 response: 00:07:08.926 { 00:07:08.926 "code": -32601, 00:07:08.926 "message": "Method not found" 00:07:08.926 } 00:07:08.926 19:13:55 -- common/autotest_common.sh@641 -- # es=1 00:07:08.926 19:13:55 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:08.926 19:13:55 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:08.926 19:13:55 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:08.926 19:13:55 -- app/cmdline.sh@1 -- # killprocess 2903086 00:07:08.926 19:13:55 -- common/autotest_common.sh@936 -- # '[' -z 2903086 ']' 00:07:08.926 19:13:55 -- common/autotest_common.sh@940 -- # kill -0 2903086 00:07:08.926 19:13:55 -- common/autotest_common.sh@941 -- # uname 00:07:08.926 19:13:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:08.926 19:13:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2903086 00:07:08.926 19:13:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:08.926 19:13:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:08.926 19:13:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2903086' 00:07:08.926 killing process with pid 2903086 00:07:08.926 19:13:55 -- common/autotest_common.sh@955 -- # kill 2903086 00:07:08.926 19:13:55 -- common/autotest_common.sh@960 -- # wait 2903086 00:07:09.183 00:07:09.184 real 0m1.772s 00:07:09.184 user 0m2.026s 00:07:09.184 sys 0m0.521s 00:07:09.184 19:13:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:09.184 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.184 ************************************ 00:07:09.184 END TEST app_cmdline 00:07:09.184 ************************************ 00:07:09.441 19:13:56 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:09.441 19:13:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:09.442 19:13:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.442 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.442 ************************************ 00:07:09.442 START TEST version 00:07:09.442 ************************************ 00:07:09.442 19:13:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:09.442 * Looking for test storage... 00:07:09.442 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:09.442 19:13:56 -- app/version.sh@17 -- # get_header_version major 00:07:09.442 19:13:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:09.442 19:13:56 -- app/version.sh@14 -- # cut -f2 00:07:09.442 19:13:56 -- app/version.sh@14 -- # tr -d '"' 00:07:09.442 19:13:56 -- app/version.sh@17 -- # major=24 00:07:09.442 19:13:56 -- app/version.sh@18 -- # get_header_version minor 00:07:09.442 19:13:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:09.442 19:13:56 -- app/version.sh@14 -- # cut -f2 00:07:09.442 19:13:56 -- app/version.sh@14 -- # tr -d '"' 00:07:09.442 19:13:56 -- app/version.sh@18 -- # minor=5 00:07:09.442 19:13:56 -- app/version.sh@19 -- # get_header_version patch 00:07:09.442 19:13:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:09.442 19:13:56 -- app/version.sh@14 -- # cut -f2 00:07:09.442 19:13:56 -- app/version.sh@14 -- # tr -d '"' 00:07:09.442 19:13:56 -- app/version.sh@19 -- # patch=0 00:07:09.442 19:13:56 -- app/version.sh@20 -- # get_header_version suffix 00:07:09.442 19:13:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:09.442 19:13:56 -- app/version.sh@14 -- # cut -f2 00:07:09.442 19:13:56 -- app/version.sh@14 -- # tr -d '"' 00:07:09.700 19:13:56 -- app/version.sh@20 -- # suffix=-pre 00:07:09.700 19:13:56 -- app/version.sh@22 -- # version=24.5 00:07:09.700 19:13:56 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:09.700 19:13:56 -- app/version.sh@28 -- # version=24.5rc0 00:07:09.700 19:13:56 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:09.700 19:13:56 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:09.700 19:13:56 -- app/version.sh@30 -- # py_version=24.5rc0 00:07:09.700 19:13:56 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:07:09.700 00:07:09.700 real 0m0.165s 00:07:09.700 user 0m0.074s 00:07:09.700 sys 0m0.135s 00:07:09.700 19:13:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:09.700 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.700 ************************************ 00:07:09.700 END TEST version 00:07:09.700 ************************************ 00:07:09.700 19:13:56 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:07:09.700 19:13:56 -- spdk/autotest.sh@194 -- # uname -s 00:07:09.700 19:13:56 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:07:09.700 19:13:56 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:09.700 19:13:56 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:09.700 19:13:56 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:07:09.700 19:13:56 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:07:09.700 19:13:56 -- spdk/autotest.sh@258 -- # timing_exit lib 00:07:09.701 19:13:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:09.701 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.701 19:13:56 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:07:09.701 19:13:56 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:07:09.701 19:13:56 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:07:09.701 19:13:56 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:07:09.701 19:13:56 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:07:09.701 19:13:56 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:09.701 19:13:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:09.701 19:13:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.701 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.959 ************************************ 00:07:09.959 START TEST nvmf_rdma 00:07:09.959 ************************************ 00:07:09.960 19:13:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:09.960 * Looking for test storage... 00:07:09.960 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:09.960 19:13:56 -- nvmf/common.sh@7 -- # uname -s 00:07:09.960 19:13:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:09.960 19:13:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:09.960 19:13:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:09.960 19:13:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:09.960 19:13:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:09.960 19:13:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:09.960 19:13:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:09.960 19:13:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:09.960 19:13:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:09.960 19:13:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:09.960 19:13:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:07:09.960 19:13:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:07:09.960 19:13:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:09.960 19:13:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:09.960 19:13:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:09.960 19:13:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:09.960 19:13:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:09.960 19:13:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:09.960 19:13:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:09.960 19:13:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:09.960 19:13:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.960 19:13:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.960 19:13:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.960 19:13:56 -- paths/export.sh@5 -- # export PATH 00:07:09.960 19:13:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.960 19:13:56 -- nvmf/common.sh@47 -- # : 0 00:07:09.960 19:13:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:09.960 19:13:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:09.960 19:13:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:09.960 19:13:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:09.960 19:13:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:09.960 19:13:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:09.960 19:13:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:09.960 19:13:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:09.960 19:13:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:09.960 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:09.960 19:13:56 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:09.960 19:13:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:09.960 19:13:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.960 19:13:56 -- common/autotest_common.sh@10 -- # set +x 00:07:10.219 ************************************ 00:07:10.219 START TEST nvmf_example 00:07:10.219 ************************************ 00:07:10.219 19:13:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:10.219 * Looking for test storage... 00:07:10.219 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:10.219 19:13:57 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:10.219 19:13:57 -- nvmf/common.sh@7 -- # uname -s 00:07:10.219 19:13:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:10.219 19:13:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:10.219 19:13:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:10.219 19:13:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:10.219 19:13:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:10.219 19:13:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:10.219 19:13:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:10.219 19:13:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:10.219 19:13:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:10.219 19:13:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:10.219 19:13:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:07:10.219 19:13:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:07:10.219 19:13:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:10.219 19:13:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:10.219 19:13:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:10.219 19:13:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:10.219 19:13:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:10.219 19:13:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:10.219 19:13:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:10.219 19:13:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:10.219 19:13:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.219 19:13:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.219 19:13:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.219 19:13:57 -- paths/export.sh@5 -- # export PATH 00:07:10.219 19:13:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.219 19:13:57 -- nvmf/common.sh@47 -- # : 0 00:07:10.219 19:13:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:10.219 19:13:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:10.219 19:13:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:10.219 19:13:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:10.219 19:13:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:10.219 19:13:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:10.219 19:13:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:10.219 19:13:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:10.219 19:13:57 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:10.219 19:13:57 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:10.219 19:13:57 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:10.219 19:13:57 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:10.219 19:13:57 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:10.219 19:13:57 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:10.219 19:13:57 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:10.219 19:13:57 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:10.219 19:13:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:10.219 19:13:57 -- common/autotest_common.sh@10 -- # set +x 00:07:10.219 19:13:57 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:10.219 19:13:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:10.219 19:13:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:10.219 19:13:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:10.219 19:13:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:10.219 19:13:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:10.219 19:13:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:10.219 19:13:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:10.219 19:13:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:10.219 19:13:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:10.219 19:13:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:10.219 19:13:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:10.219 19:13:57 -- common/autotest_common.sh@10 -- # set +x 00:07:16.779 19:14:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:16.779 19:14:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:16.779 19:14:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:16.779 19:14:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:16.779 19:14:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:16.779 19:14:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:16.779 19:14:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:16.779 19:14:02 -- nvmf/common.sh@295 -- # net_devs=() 00:07:16.779 19:14:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:16.779 19:14:02 -- nvmf/common.sh@296 -- # e810=() 00:07:16.779 19:14:02 -- nvmf/common.sh@296 -- # local -ga e810 00:07:16.779 19:14:02 -- nvmf/common.sh@297 -- # x722=() 00:07:16.779 19:14:02 -- nvmf/common.sh@297 -- # local -ga x722 00:07:16.779 19:14:02 -- nvmf/common.sh@298 -- # mlx=() 00:07:16.779 19:14:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:16.779 19:14:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:16.779 19:14:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:16.779 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:16.779 19:14:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:16.779 19:14:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:16.779 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:16.779 19:14:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:16.779 19:14:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:16.779 19:14:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:16.779 19:14:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:16.779 Found net devices under 0000:18:00.0: mlx_0_0 00:07:16.779 19:14:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:16.779 19:14:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:16.779 19:14:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:16.779 Found net devices under 0000:18:00.1: mlx_0_1 00:07:16.779 19:14:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:16.779 19:14:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:16.779 19:14:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:16.779 19:14:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:16.779 19:14:02 -- nvmf/common.sh@58 -- # uname 00:07:16.779 19:14:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:16.779 19:14:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:16.779 19:14:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:16.779 19:14:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:16.779 19:14:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:16.779 19:14:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:16.779 19:14:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:16.779 19:14:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:16.779 19:14:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:16.779 19:14:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:16.779 19:14:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:16.779 19:14:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:16.779 19:14:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:16.779 19:14:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:16.779 19:14:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:16.779 19:14:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:16.779 19:14:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:16.779 19:14:02 -- nvmf/common.sh@105 -- # continue 2 00:07:16.779 19:14:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.779 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:16.779 19:14:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:16.779 19:14:02 -- nvmf/common.sh@105 -- # continue 2 00:07:16.779 19:14:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:16.779 19:14:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:16.779 19:14:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:16.780 19:14:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:16.780 19:14:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:16.780 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:16.780 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:07:16.780 altname enp24s0f0np0 00:07:16.780 altname ens785f0np0 00:07:16.780 inet 192.168.100.8/24 scope global mlx_0_0 00:07:16.780 valid_lft forever preferred_lft forever 00:07:16.780 19:14:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:16.780 19:14:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:16.780 19:14:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:16.780 19:14:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:16.780 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:16.780 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:07:16.780 altname enp24s0f1np1 00:07:16.780 altname ens785f1np1 00:07:16.780 inet 192.168.100.9/24 scope global mlx_0_1 00:07:16.780 valid_lft forever preferred_lft forever 00:07:16.780 19:14:02 -- nvmf/common.sh@411 -- # return 0 00:07:16.780 19:14:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:16.780 19:14:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:16.780 19:14:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:16.780 19:14:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:16.780 19:14:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:16.780 19:14:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:16.780 19:14:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:16.780 19:14:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:16.780 19:14:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:16.780 19:14:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:16.780 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.780 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@105 -- # continue 2 00:07:16.780 19:14:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:16.780 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.780 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:16.780 19:14:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:16.780 19:14:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@105 -- # continue 2 00:07:16.780 19:14:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:16.780 19:14:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:16.780 19:14:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:16.780 19:14:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:16.780 19:14:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:16.780 19:14:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:16.780 192.168.100.9' 00:07:16.780 19:14:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:16.780 192.168.100.9' 00:07:16.780 19:14:02 -- nvmf/common.sh@446 -- # head -n 1 00:07:16.780 19:14:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:16.780 19:14:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:16.780 192.168.100.9' 00:07:16.780 19:14:02 -- nvmf/common.sh@447 -- # tail -n +2 00:07:16.780 19:14:02 -- nvmf/common.sh@447 -- # head -n 1 00:07:16.780 19:14:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:16.780 19:14:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:16.780 19:14:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:16.780 19:14:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:16.780 19:14:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:16.780 19:14:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:16.780 19:14:02 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:16.780 19:14:02 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:16.780 19:14:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:16.780 19:14:02 -- common/autotest_common.sh@10 -- # set +x 00:07:16.780 19:14:02 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:07:16.780 19:14:02 -- target/nvmf_example.sh@34 -- # nvmfpid=2906318 00:07:16.780 19:14:02 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:16.780 19:14:02 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:16.780 19:14:02 -- target/nvmf_example.sh@36 -- # waitforlisten 2906318 00:07:16.780 19:14:02 -- common/autotest_common.sh@817 -- # '[' -z 2906318 ']' 00:07:16.780 19:14:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:16.780 19:14:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:16.780 19:14:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:16.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:16.780 19:14:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:16.780 19:14:02 -- common/autotest_common.sh@10 -- # set +x 00:07:16.780 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.780 19:14:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:16.780 19:14:03 -- common/autotest_common.sh@850 -- # return 0 00:07:16.780 19:14:03 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:16.780 19:14:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:16.780 19:14:03 -- common/autotest_common.sh@10 -- # set +x 00:07:17.038 19:14:03 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:17.038 19:14:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.038 19:14:03 -- common/autotest_common.sh@10 -- # set +x 00:07:17.038 19:14:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.038 19:14:04 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:17.038 19:14:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.038 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:17.038 19:14:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.038 19:14:04 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:17.038 19:14:04 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:17.038 19:14:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.038 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:17.296 19:14:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.296 19:14:04 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:17.296 19:14:04 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:17.296 19:14:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.296 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:17.296 19:14:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.296 19:14:04 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:17.296 19:14:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.296 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:17.296 19:14:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.296 19:14:04 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:17.296 19:14:04 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:17.296 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.494 Initializing NVMe Controllers 00:07:29.494 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:07:29.494 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:29.494 Initialization complete. Launching workers. 00:07:29.494 ======================================================== 00:07:29.494 Latency(us) 00:07:29.494 Device Information : IOPS MiB/s Average min max 00:07:29.494 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 25583.41 99.94 2501.23 620.28 15957.32 00:07:29.494 ======================================================== 00:07:29.494 Total : 25583.41 99.94 2501.23 620.28 15957.32 00:07:29.494 00:07:29.494 19:14:15 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:29.494 19:14:15 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:29.494 19:14:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:29.494 19:14:15 -- nvmf/common.sh@117 -- # sync 00:07:29.494 19:14:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:29.494 19:14:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:29.494 19:14:15 -- nvmf/common.sh@120 -- # set +e 00:07:29.494 19:14:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:29.494 19:14:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:29.494 rmmod nvme_rdma 00:07:29.494 rmmod nvme_fabrics 00:07:29.494 19:14:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:29.494 19:14:15 -- nvmf/common.sh@124 -- # set -e 00:07:29.494 19:14:15 -- nvmf/common.sh@125 -- # return 0 00:07:29.494 19:14:15 -- nvmf/common.sh@478 -- # '[' -n 2906318 ']' 00:07:29.494 19:14:15 -- nvmf/common.sh@479 -- # killprocess 2906318 00:07:29.494 19:14:15 -- common/autotest_common.sh@936 -- # '[' -z 2906318 ']' 00:07:29.494 19:14:15 -- common/autotest_common.sh@940 -- # kill -0 2906318 00:07:29.494 19:14:15 -- common/autotest_common.sh@941 -- # uname 00:07:29.494 19:14:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.494 19:14:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2906318 00:07:29.494 19:14:15 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:29.494 19:14:15 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:29.495 19:14:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2906318' 00:07:29.495 killing process with pid 2906318 00:07:29.495 19:14:15 -- common/autotest_common.sh@955 -- # kill 2906318 00:07:29.495 19:14:15 -- common/autotest_common.sh@960 -- # wait 2906318 00:07:29.495 [2024-04-24 19:14:15.507786] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:29.495 nvmf threads initialize successfully 00:07:29.495 bdev subsystem init successfully 00:07:29.495 created a nvmf target service 00:07:29.495 create targets's poll groups done 00:07:29.495 all subsystems of target started 00:07:29.495 nvmf target is running 00:07:29.495 all subsystems of target stopped 00:07:29.495 destroy targets's poll groups done 00:07:29.495 destroyed the nvmf target service 00:07:29.495 bdev subsystem finish successfully 00:07:29.495 nvmf threads destroy successfully 00:07:29.495 19:14:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:29.495 19:14:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:29.495 19:14:15 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:29.495 19:14:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:29.495 19:14:15 -- common/autotest_common.sh@10 -- # set +x 00:07:29.495 00:07:29.495 real 0m18.698s 00:07:29.495 user 0m52.026s 00:07:29.495 sys 0m4.861s 00:07:29.495 19:14:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:29.495 19:14:15 -- common/autotest_common.sh@10 -- # set +x 00:07:29.495 ************************************ 00:07:29.495 END TEST nvmf_example 00:07:29.495 ************************************ 00:07:29.495 19:14:15 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:07:29.495 19:14:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:29.495 19:14:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.495 19:14:15 -- common/autotest_common.sh@10 -- # set +x 00:07:29.495 ************************************ 00:07:29.495 START TEST nvmf_filesystem 00:07:29.495 ************************************ 00:07:29.495 19:14:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:07:29.495 * Looking for test storage... 00:07:29.495 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.495 19:14:16 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:07:29.495 19:14:16 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:29.495 19:14:16 -- common/autotest_common.sh@34 -- # set -e 00:07:29.495 19:14:16 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:29.495 19:14:16 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:29.495 19:14:16 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:07:29.495 19:14:16 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:29.495 19:14:16 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:07:29.495 19:14:16 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:29.495 19:14:16 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:29.495 19:14:16 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:29.495 19:14:16 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:29.495 19:14:16 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:29.495 19:14:16 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:29.495 19:14:16 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:29.495 19:14:16 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:29.495 19:14:16 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:29.495 19:14:16 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:29.495 19:14:16 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:29.495 19:14:16 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:29.495 19:14:16 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:29.495 19:14:16 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:29.495 19:14:16 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:29.495 19:14:16 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:29.495 19:14:16 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:07:29.495 19:14:16 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:29.495 19:14:16 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:29.495 19:14:16 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:29.495 19:14:16 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:29.495 19:14:16 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:29.495 19:14:16 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:29.495 19:14:16 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:29.495 19:14:16 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:29.495 19:14:16 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:29.495 19:14:16 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:29.495 19:14:16 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:29.495 19:14:16 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:29.495 19:14:16 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:29.495 19:14:16 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:29.495 19:14:16 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:29.495 19:14:16 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:07:29.495 19:14:16 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:29.495 19:14:16 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:29.495 19:14:16 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:29.495 19:14:16 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:29.495 19:14:16 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:29.495 19:14:16 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:29.495 19:14:16 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:29.495 19:14:16 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:29.495 19:14:16 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:29.495 19:14:16 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:29.495 19:14:16 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:29.495 19:14:16 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:29.495 19:14:16 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:07:29.495 19:14:16 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:29.495 19:14:16 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:07:29.495 19:14:16 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:07:29.495 19:14:16 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:07:29.495 19:14:16 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:07:29.495 19:14:16 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:07:29.495 19:14:16 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:07:29.495 19:14:16 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:07:29.495 19:14:16 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:07:29.495 19:14:16 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:07:29.495 19:14:16 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:07:29.495 19:14:16 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:07:29.495 19:14:16 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:07:29.495 19:14:16 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:07:29.495 19:14:16 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:29.495 19:14:16 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:07:29.495 19:14:16 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:07:29.495 19:14:16 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:07:29.495 19:14:16 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:07:29.495 19:14:16 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:07:29.495 19:14:16 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:07:29.495 19:14:16 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:07:29.495 19:14:16 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:07:29.495 19:14:16 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:07:29.495 19:14:16 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:07:29.495 19:14:16 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:07:29.495 19:14:16 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:29.495 19:14:16 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:07:29.495 19:14:16 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:07:29.495 19:14:16 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:07:29.495 19:14:16 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:07:29.495 19:14:16 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:07:29.495 19:14:16 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:07:29.495 19:14:16 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:29.495 19:14:16 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:29.495 19:14:16 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:29.495 19:14:16 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:29.495 19:14:16 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:29.495 19:14:16 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:29.495 19:14:16 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:29.495 19:14:16 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:29.495 19:14:16 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:29.495 19:14:16 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:29.495 19:14:16 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:07:29.495 19:14:16 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:29.495 #define SPDK_CONFIG_H 00:07:29.495 #define SPDK_CONFIG_APPS 1 00:07:29.495 #define SPDK_CONFIG_ARCH native 00:07:29.495 #undef SPDK_CONFIG_ASAN 00:07:29.495 #undef SPDK_CONFIG_AVAHI 00:07:29.496 #undef SPDK_CONFIG_CET 00:07:29.496 #define SPDK_CONFIG_COVERAGE 1 00:07:29.496 #define SPDK_CONFIG_CROSS_PREFIX 00:07:29.496 #undef SPDK_CONFIG_CRYPTO 00:07:29.496 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:29.496 #undef SPDK_CONFIG_CUSTOMOCF 00:07:29.496 #undef SPDK_CONFIG_DAOS 00:07:29.496 #define SPDK_CONFIG_DAOS_DIR 00:07:29.496 #define SPDK_CONFIG_DEBUG 1 00:07:29.496 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:29.496 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:07:29.496 #define SPDK_CONFIG_DPDK_INC_DIR 00:07:29.496 #define SPDK_CONFIG_DPDK_LIB_DIR 00:07:29.496 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:29.496 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:07:29.496 #define SPDK_CONFIG_EXAMPLES 1 00:07:29.496 #undef SPDK_CONFIG_FC 00:07:29.496 #define SPDK_CONFIG_FC_PATH 00:07:29.496 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:29.496 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:29.496 #undef SPDK_CONFIG_FUSE 00:07:29.496 #undef SPDK_CONFIG_FUZZER 00:07:29.496 #define SPDK_CONFIG_FUZZER_LIB 00:07:29.496 #undef SPDK_CONFIG_GOLANG 00:07:29.496 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:29.496 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:07:29.496 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:29.496 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:07:29.496 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:29.496 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:29.496 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:29.496 #define SPDK_CONFIG_IDXD 1 00:07:29.496 #undef SPDK_CONFIG_IDXD_KERNEL 00:07:29.496 #undef SPDK_CONFIG_IPSEC_MB 00:07:29.496 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:29.496 #define SPDK_CONFIG_ISAL 1 00:07:29.496 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:29.496 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:29.496 #define SPDK_CONFIG_LIBDIR 00:07:29.496 #undef SPDK_CONFIG_LTO 00:07:29.496 #define SPDK_CONFIG_MAX_LCORES 00:07:29.496 #define SPDK_CONFIG_NVME_CUSE 1 00:07:29.496 #undef SPDK_CONFIG_OCF 00:07:29.496 #define SPDK_CONFIG_OCF_PATH 00:07:29.496 #define SPDK_CONFIG_OPENSSL_PATH 00:07:29.496 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:29.496 #define SPDK_CONFIG_PGO_DIR 00:07:29.496 #undef SPDK_CONFIG_PGO_USE 00:07:29.496 #define SPDK_CONFIG_PREFIX /usr/local 00:07:29.496 #undef SPDK_CONFIG_RAID5F 00:07:29.496 #undef SPDK_CONFIG_RBD 00:07:29.496 #define SPDK_CONFIG_RDMA 1 00:07:29.496 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:29.496 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:29.496 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:29.496 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:29.496 #define SPDK_CONFIG_SHARED 1 00:07:29.496 #undef SPDK_CONFIG_SMA 00:07:29.496 #define SPDK_CONFIG_TESTS 1 00:07:29.496 #undef SPDK_CONFIG_TSAN 00:07:29.496 #define SPDK_CONFIG_UBLK 1 00:07:29.496 #define SPDK_CONFIG_UBSAN 1 00:07:29.496 #undef SPDK_CONFIG_UNIT_TESTS 00:07:29.496 #undef SPDK_CONFIG_URING 00:07:29.496 #define SPDK_CONFIG_URING_PATH 00:07:29.496 #undef SPDK_CONFIG_URING_ZNS 00:07:29.496 #undef SPDK_CONFIG_USDT 00:07:29.496 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:29.496 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:29.496 #undef SPDK_CONFIG_VFIO_USER 00:07:29.496 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:29.496 #define SPDK_CONFIG_VHOST 1 00:07:29.496 #define SPDK_CONFIG_VIRTIO 1 00:07:29.496 #undef SPDK_CONFIG_VTUNE 00:07:29.496 #define SPDK_CONFIG_VTUNE_DIR 00:07:29.496 #define SPDK_CONFIG_WERROR 1 00:07:29.496 #define SPDK_CONFIG_WPDK_DIR 00:07:29.496 #undef SPDK_CONFIG_XNVME 00:07:29.496 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:29.496 19:14:16 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:29.496 19:14:16 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:29.496 19:14:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.496 19:14:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.496 19:14:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.496 19:14:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.496 19:14:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.496 19:14:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.496 19:14:16 -- paths/export.sh@5 -- # export PATH 00:07:29.496 19:14:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.496 19:14:16 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:07:29.496 19:14:16 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:07:29.496 19:14:16 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:07:29.496 19:14:16 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:07:29.496 19:14:16 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:29.496 19:14:16 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:29.496 19:14:16 -- pm/common@67 -- # TEST_TAG=N/A 00:07:29.496 19:14:16 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:07:29.496 19:14:16 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:07:29.496 19:14:16 -- pm/common@71 -- # uname -s 00:07:29.496 19:14:16 -- pm/common@71 -- # PM_OS=Linux 00:07:29.496 19:14:16 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:07:29.496 19:14:16 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:07:29.496 19:14:16 -- pm/common@76 -- # [[ Linux == Linux ]] 00:07:29.496 19:14:16 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:07:29.496 19:14:16 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:07:29.496 19:14:16 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:07:29.496 19:14:16 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:07:29.496 19:14:16 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:07:29.496 19:14:16 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:07:29.496 19:14:16 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:07:29.496 19:14:16 -- common/autotest_common.sh@57 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:07:29.496 19:14:16 -- common/autotest_common.sh@61 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:29.496 19:14:16 -- common/autotest_common.sh@63 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:07:29.496 19:14:16 -- common/autotest_common.sh@65 -- # : 1 00:07:29.496 19:14:16 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:29.496 19:14:16 -- common/autotest_common.sh@67 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:07:29.496 19:14:16 -- common/autotest_common.sh@69 -- # : 00:07:29.496 19:14:16 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:07:29.496 19:14:16 -- common/autotest_common.sh@71 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:07:29.496 19:14:16 -- common/autotest_common.sh@73 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:07:29.496 19:14:16 -- common/autotest_common.sh@75 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:07:29.496 19:14:16 -- common/autotest_common.sh@77 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:29.496 19:14:16 -- common/autotest_common.sh@79 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:07:29.496 19:14:16 -- common/autotest_common.sh@81 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:07:29.496 19:14:16 -- common/autotest_common.sh@83 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:07:29.496 19:14:16 -- common/autotest_common.sh@85 -- # : 1 00:07:29.496 19:14:16 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:07:29.496 19:14:16 -- common/autotest_common.sh@87 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:07:29.496 19:14:16 -- common/autotest_common.sh@89 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:07:29.496 19:14:16 -- common/autotest_common.sh@91 -- # : 1 00:07:29.496 19:14:16 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:07:29.496 19:14:16 -- common/autotest_common.sh@93 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:07:29.496 19:14:16 -- common/autotest_common.sh@95 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:29.496 19:14:16 -- common/autotest_common.sh@97 -- # : 0 00:07:29.496 19:14:16 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:07:29.496 19:14:16 -- common/autotest_common.sh@99 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:07:29.497 19:14:16 -- common/autotest_common.sh@101 -- # : rdma 00:07:29.497 19:14:16 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:29.497 19:14:16 -- common/autotest_common.sh@103 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:07:29.497 19:14:16 -- common/autotest_common.sh@105 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:07:29.497 19:14:16 -- common/autotest_common.sh@107 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:07:29.497 19:14:16 -- common/autotest_common.sh@109 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:07:29.497 19:14:16 -- common/autotest_common.sh@111 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:07:29.497 19:14:16 -- common/autotest_common.sh@113 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:07:29.497 19:14:16 -- common/autotest_common.sh@115 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:07:29.497 19:14:16 -- common/autotest_common.sh@117 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:29.497 19:14:16 -- common/autotest_common.sh@119 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:07:29.497 19:14:16 -- common/autotest_common.sh@121 -- # : 1 00:07:29.497 19:14:16 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:07:29.497 19:14:16 -- common/autotest_common.sh@123 -- # : 00:07:29.497 19:14:16 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:29.497 19:14:16 -- common/autotest_common.sh@125 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:07:29.497 19:14:16 -- common/autotest_common.sh@127 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:07:29.497 19:14:16 -- common/autotest_common.sh@129 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:07:29.497 19:14:16 -- common/autotest_common.sh@131 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:07:29.497 19:14:16 -- common/autotest_common.sh@133 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:07:29.497 19:14:16 -- common/autotest_common.sh@135 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:07:29.497 19:14:16 -- common/autotest_common.sh@137 -- # : 00:07:29.497 19:14:16 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:07:29.497 19:14:16 -- common/autotest_common.sh@139 -- # : true 00:07:29.497 19:14:16 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:07:29.497 19:14:16 -- common/autotest_common.sh@141 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:07:29.497 19:14:16 -- common/autotest_common.sh@143 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:07:29.497 19:14:16 -- common/autotest_common.sh@145 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:07:29.497 19:14:16 -- common/autotest_common.sh@147 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:07:29.497 19:14:16 -- common/autotest_common.sh@149 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:07:29.497 19:14:16 -- common/autotest_common.sh@151 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:07:29.497 19:14:16 -- common/autotest_common.sh@153 -- # : mlx5 00:07:29.497 19:14:16 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:07:29.497 19:14:16 -- common/autotest_common.sh@155 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:07:29.497 19:14:16 -- common/autotest_common.sh@157 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:07:29.497 19:14:16 -- common/autotest_common.sh@159 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:07:29.497 19:14:16 -- common/autotest_common.sh@161 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:07:29.497 19:14:16 -- common/autotest_common.sh@163 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:07:29.497 19:14:16 -- common/autotest_common.sh@166 -- # : 00:07:29.497 19:14:16 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:07:29.497 19:14:16 -- common/autotest_common.sh@168 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:07:29.497 19:14:16 -- common/autotest_common.sh@170 -- # : 0 00:07:29.497 19:14:16 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:29.497 19:14:16 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:29.497 19:14:16 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:29.497 19:14:16 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:29.497 19:14:16 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:29.497 19:14:16 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:29.497 19:14:16 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:29.497 19:14:16 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:07:29.497 19:14:16 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:29.497 19:14:16 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:29.497 19:14:16 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:29.497 19:14:16 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:29.497 19:14:16 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:29.497 19:14:16 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:07:29.497 19:14:16 -- common/autotest_common.sh@199 -- # cat 00:07:29.497 19:14:16 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:07:29.497 19:14:16 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:29.497 19:14:16 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:29.497 19:14:16 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:29.497 19:14:16 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:29.497 19:14:16 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:07:29.497 19:14:16 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:07:29.497 19:14:16 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:29.497 19:14:16 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:29.497 19:14:16 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:29.497 19:14:16 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:29.497 19:14:16 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:29.497 19:14:16 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:29.497 19:14:16 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:29.497 19:14:16 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:29.497 19:14:16 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:29.497 19:14:16 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:29.498 19:14:16 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:29.498 19:14:16 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:29.498 19:14:16 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:07:29.498 19:14:16 -- common/autotest_common.sh@252 -- # export valgrind= 00:07:29.498 19:14:16 -- common/autotest_common.sh@252 -- # valgrind= 00:07:29.498 19:14:16 -- common/autotest_common.sh@258 -- # uname -s 00:07:29.498 19:14:16 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:07:29.498 19:14:16 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:07:29.498 19:14:16 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:07:29.498 19:14:16 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:07:29.498 19:14:16 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@268 -- # MAKE=make 00:07:29.498 19:14:16 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:07:29.498 19:14:16 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:07:29.498 19:14:16 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:07:29.498 19:14:16 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:07:29.498 19:14:16 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:07:29.498 19:14:16 -- common/autotest_common.sh@289 -- # for i in "$@" 00:07:29.498 19:14:16 -- common/autotest_common.sh@290 -- # case "$i" in 00:07:29.498 19:14:16 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:07:29.498 19:14:16 -- common/autotest_common.sh@307 -- # [[ -z 2908209 ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@307 -- # kill -0 2908209 00:07:29.498 19:14:16 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:07:29.498 19:14:16 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:07:29.498 19:14:16 -- common/autotest_common.sh@320 -- # local mount target_dir 00:07:29.498 19:14:16 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:07:29.498 19:14:16 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:07:29.498 19:14:16 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:07:29.498 19:14:16 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:07:29.498 19:14:16 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.AoYfvL 00:07:29.498 19:14:16 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:29.498 19:14:16 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.AoYfvL/tests/target /tmp/spdk.AoYfvL 00:07:29.498 19:14:16 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@316 -- # df -T 00:07:29.498 19:14:16 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=989405184 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=4295024640 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=52083159040 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=61742698496 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=9659539456 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/sda1 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=xfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=221821267968 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=239938535424 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=18117267456 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=30866636800 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871347200 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=4710400 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=12339298304 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=12348542976 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=9244672 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=30871003136 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871351296 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=348160 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # avails["$mount"]=6174265344 00:07:29.498 19:14:16 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6174269440 00:07:29.498 19:14:16 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:07:29.498 19:14:16 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:07:29.498 19:14:16 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:07:29.498 * Looking for test storage... 00:07:29.498 19:14:16 -- common/autotest_common.sh@357 -- # local target_space new_size 00:07:29.498 19:14:16 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:07:29.498 19:14:16 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:29.498 19:14:16 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.498 19:14:16 -- common/autotest_common.sh@361 -- # mount=/ 00:07:29.498 19:14:16 -- common/autotest_common.sh@363 -- # target_space=52083159040 00:07:29.498 19:14:16 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:07:29.498 19:14:16 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:07:29.498 19:14:16 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@370 -- # new_size=11874131968 00:07:29.498 19:14:16 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:29.498 19:14:16 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.498 19:14:16 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.498 19:14:16 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.498 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:29.498 19:14:16 -- common/autotest_common.sh@378 -- # return 0 00:07:29.498 19:14:16 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:07:29.498 19:14:16 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:07:29.498 19:14:16 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:29.498 19:14:16 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:29.498 19:14:16 -- common/autotest_common.sh@1673 -- # true 00:07:29.498 19:14:16 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:07:29.498 19:14:16 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:29.498 19:14:16 -- common/autotest_common.sh@27 -- # exec 00:07:29.498 19:14:16 -- common/autotest_common.sh@29 -- # exec 00:07:29.498 19:14:16 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:29.498 19:14:16 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:29.498 19:14:16 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:29.498 19:14:16 -- common/autotest_common.sh@18 -- # set -x 00:07:29.498 19:14:16 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.498 19:14:16 -- nvmf/common.sh@7 -- # uname -s 00:07:29.498 19:14:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.498 19:14:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.498 19:14:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.498 19:14:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.498 19:14:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.498 19:14:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.498 19:14:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.498 19:14:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.498 19:14:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.498 19:14:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.498 19:14:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:07:29.498 19:14:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:07:29.499 19:14:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.499 19:14:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.499 19:14:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.499 19:14:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:29.499 19:14:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:29.499 19:14:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.499 19:14:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.499 19:14:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.499 19:14:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.499 19:14:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.499 19:14:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.499 19:14:16 -- paths/export.sh@5 -- # export PATH 00:07:29.499 19:14:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.499 19:14:16 -- nvmf/common.sh@47 -- # : 0 00:07:29.499 19:14:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:29.499 19:14:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:29.499 19:14:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:29.499 19:14:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.499 19:14:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.499 19:14:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:29.499 19:14:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:29.499 19:14:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:29.499 19:14:16 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:29.499 19:14:16 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:29.499 19:14:16 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:29.499 19:14:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:29.499 19:14:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.499 19:14:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:29.499 19:14:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:29.499 19:14:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:29.499 19:14:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.499 19:14:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.499 19:14:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.499 19:14:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:29.499 19:14:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:29.499 19:14:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:29.499 19:14:16 -- common/autotest_common.sh@10 -- # set +x 00:07:34.824 19:14:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:34.824 19:14:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:34.824 19:14:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:34.824 19:14:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:34.824 19:14:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:34.824 19:14:21 -- nvmf/common.sh@295 -- # net_devs=() 00:07:34.824 19:14:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@296 -- # e810=() 00:07:34.824 19:14:21 -- nvmf/common.sh@296 -- # local -ga e810 00:07:34.824 19:14:21 -- nvmf/common.sh@297 -- # x722=() 00:07:34.824 19:14:21 -- nvmf/common.sh@297 -- # local -ga x722 00:07:34.824 19:14:21 -- nvmf/common.sh@298 -- # mlx=() 00:07:34.824 19:14:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:34.824 19:14:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:34.824 19:14:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:34.824 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:34.824 19:14:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:34.824 19:14:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:34.824 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:34.824 19:14:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:34.824 19:14:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.824 19:14:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.824 19:14:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:34.824 Found net devices under 0000:18:00.0: mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.824 19:14:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.824 19:14:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:34.824 Found net devices under 0000:18:00.1: mlx_0_1 00:07:34.824 19:14:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.824 19:14:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:34.824 19:14:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:34.824 19:14:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:34.824 19:14:21 -- nvmf/common.sh@58 -- # uname 00:07:34.824 19:14:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:34.824 19:14:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:34.824 19:14:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:34.824 19:14:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:34.824 19:14:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:34.824 19:14:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:34.824 19:14:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:34.824 19:14:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:34.824 19:14:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:34.824 19:14:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:34.824 19:14:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:34.824 19:14:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:34.824 19:14:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:34.824 19:14:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@105 -- # continue 2 00:07:34.824 19:14:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:34.824 19:14:21 -- nvmf/common.sh@105 -- # continue 2 00:07:34.824 19:14:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:34.824 19:14:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:34.824 19:14:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:34.824 19:14:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:34.824 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:34.824 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:07:34.824 altname enp24s0f0np0 00:07:34.824 altname ens785f0np0 00:07:34.824 inet 192.168.100.8/24 scope global mlx_0_0 00:07:34.824 valid_lft forever preferred_lft forever 00:07:34.824 19:14:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:34.824 19:14:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:34.824 19:14:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:34.824 19:14:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:34.824 19:14:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:34.824 19:14:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:34.824 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:34.824 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:07:34.824 altname enp24s0f1np1 00:07:34.824 altname ens785f1np1 00:07:34.824 inet 192.168.100.9/24 scope global mlx_0_1 00:07:34.824 valid_lft forever preferred_lft forever 00:07:34.824 19:14:21 -- nvmf/common.sh@411 -- # return 0 00:07:34.824 19:14:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:34.824 19:14:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:34.824 19:14:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:34.824 19:14:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:34.824 19:14:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:34.824 19:14:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:34.824 19:14:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:34.824 19:14:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:34.824 19:14:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.824 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:34.824 19:14:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:34.824 19:14:21 -- nvmf/common.sh@105 -- # continue 2 00:07:34.824 19:14:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:34.825 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.825 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:34.825 19:14:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:34.825 19:14:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:34.825 19:14:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:34.825 19:14:21 -- nvmf/common.sh@105 -- # continue 2 00:07:34.825 19:14:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:34.825 19:14:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:34.825 19:14:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:34.825 19:14:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:34.825 19:14:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:34.825 19:14:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:34.825 19:14:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:34.825 19:14:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:34.825 192.168.100.9' 00:07:34.825 19:14:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:34.825 192.168.100.9' 00:07:34.825 19:14:21 -- nvmf/common.sh@446 -- # head -n 1 00:07:34.825 19:14:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:35.083 19:14:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:35.083 192.168.100.9' 00:07:35.083 19:14:21 -- nvmf/common.sh@447 -- # head -n 1 00:07:35.083 19:14:21 -- nvmf/common.sh@447 -- # tail -n +2 00:07:35.083 19:14:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:35.083 19:14:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:35.083 19:14:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:35.083 19:14:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:35.083 19:14:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:35.083 19:14:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:35.083 19:14:21 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:35.083 19:14:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:35.083 19:14:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.083 19:14:21 -- common/autotest_common.sh@10 -- # set +x 00:07:35.083 ************************************ 00:07:35.083 START TEST nvmf_filesystem_no_in_capsule 00:07:35.083 ************************************ 00:07:35.083 19:14:22 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:07:35.083 19:14:22 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:35.083 19:14:22 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:35.083 19:14:22 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:35.083 19:14:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:35.083 19:14:22 -- common/autotest_common.sh@10 -- # set +x 00:07:35.083 19:14:22 -- nvmf/common.sh@470 -- # nvmfpid=2910937 00:07:35.083 19:14:22 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:35.083 19:14:22 -- nvmf/common.sh@471 -- # waitforlisten 2910937 00:07:35.083 19:14:22 -- common/autotest_common.sh@817 -- # '[' -z 2910937 ']' 00:07:35.083 19:14:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:35.083 19:14:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:35.083 19:14:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:35.083 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:35.083 19:14:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:35.083 19:14:22 -- common/autotest_common.sh@10 -- # set +x 00:07:35.341 [2024-04-24 19:14:22.105868] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:35.341 [2024-04-24 19:14:22.105926] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:35.341 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.341 [2024-04-24 19:14:22.179535] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:35.341 [2024-04-24 19:14:22.268492] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:35.341 [2024-04-24 19:14:22.268535] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:35.341 [2024-04-24 19:14:22.268545] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:35.341 [2024-04-24 19:14:22.268560] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:35.341 [2024-04-24 19:14:22.268567] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:35.341 [2024-04-24 19:14:22.268669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:35.341 [2024-04-24 19:14:22.268770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:35.341 [2024-04-24 19:14:22.268852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:35.341 [2024-04-24 19:14:22.268853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.906 19:14:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:35.906 19:14:22 -- common/autotest_common.sh@850 -- # return 0 00:07:35.906 19:14:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:35.906 19:14:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:35.906 19:14:22 -- common/autotest_common.sh@10 -- # set +x 00:07:36.164 19:14:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:36.164 19:14:22 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:36.164 19:14:22 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:07:36.164 19:14:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.164 19:14:22 -- common/autotest_common.sh@10 -- # set +x 00:07:36.164 [2024-04-24 19:14:22.965702] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:07:36.164 [2024-04-24 19:14:22.987597] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x89d240/0x8a1730) succeed. 00:07:36.164 [2024-04-24 19:14:22.998030] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x89e880/0x8e2dc0) succeed. 00:07:36.164 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.164 19:14:23 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:36.164 19:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.164 19:14:23 -- common/autotest_common.sh@10 -- # set +x 00:07:36.422 Malloc1 00:07:36.422 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.422 19:14:23 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:36.422 19:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.422 19:14:23 -- common/autotest_common.sh@10 -- # set +x 00:07:36.422 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.422 19:14:23 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:36.422 19:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.422 19:14:23 -- common/autotest_common.sh@10 -- # set +x 00:07:36.422 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.422 19:14:23 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:36.422 19:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.422 19:14:23 -- common/autotest_common.sh@10 -- # set +x 00:07:36.422 [2024-04-24 19:14:23.262026] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:36.422 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.422 19:14:23 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:36.422 19:14:23 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:07:36.422 19:14:23 -- common/autotest_common.sh@1365 -- # local bdev_info 00:07:36.422 19:14:23 -- common/autotest_common.sh@1366 -- # local bs 00:07:36.422 19:14:23 -- common/autotest_common.sh@1367 -- # local nb 00:07:36.422 19:14:23 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:36.422 19:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:36.422 19:14:23 -- common/autotest_common.sh@10 -- # set +x 00:07:36.422 19:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:36.422 19:14:23 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:07:36.422 { 00:07:36.422 "name": "Malloc1", 00:07:36.422 "aliases": [ 00:07:36.422 "946cacf0-a152-4620-8ebf-4b74687d6281" 00:07:36.422 ], 00:07:36.422 "product_name": "Malloc disk", 00:07:36.422 "block_size": 512, 00:07:36.422 "num_blocks": 1048576, 00:07:36.422 "uuid": "946cacf0-a152-4620-8ebf-4b74687d6281", 00:07:36.422 "assigned_rate_limits": { 00:07:36.422 "rw_ios_per_sec": 0, 00:07:36.422 "rw_mbytes_per_sec": 0, 00:07:36.422 "r_mbytes_per_sec": 0, 00:07:36.422 "w_mbytes_per_sec": 0 00:07:36.422 }, 00:07:36.422 "claimed": true, 00:07:36.422 "claim_type": "exclusive_write", 00:07:36.422 "zoned": false, 00:07:36.422 "supported_io_types": { 00:07:36.422 "read": true, 00:07:36.422 "write": true, 00:07:36.422 "unmap": true, 00:07:36.422 "write_zeroes": true, 00:07:36.422 "flush": true, 00:07:36.422 "reset": true, 00:07:36.422 "compare": false, 00:07:36.422 "compare_and_write": false, 00:07:36.422 "abort": true, 00:07:36.422 "nvme_admin": false, 00:07:36.422 "nvme_io": false 00:07:36.422 }, 00:07:36.422 "memory_domains": [ 00:07:36.422 { 00:07:36.422 "dma_device_id": "system", 00:07:36.422 "dma_device_type": 1 00:07:36.422 }, 00:07:36.422 { 00:07:36.422 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:36.422 "dma_device_type": 2 00:07:36.422 } 00:07:36.422 ], 00:07:36.422 "driver_specific": {} 00:07:36.422 } 00:07:36.422 ]' 00:07:36.422 19:14:23 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:07:36.422 19:14:23 -- common/autotest_common.sh@1369 -- # bs=512 00:07:36.422 19:14:23 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:07:36.422 19:14:23 -- common/autotest_common.sh@1370 -- # nb=1048576 00:07:36.422 19:14:23 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:07:36.422 19:14:23 -- common/autotest_common.sh@1374 -- # echo 512 00:07:36.422 19:14:23 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:36.422 19:14:23 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:37.794 19:14:24 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:37.794 19:14:24 -- common/autotest_common.sh@1184 -- # local i=0 00:07:37.794 19:14:24 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:37.794 19:14:24 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:37.794 19:14:24 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:39.692 19:14:26 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:39.692 19:14:26 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:39.692 19:14:26 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:39.692 19:14:26 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:39.692 19:14:26 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:39.692 19:14:26 -- common/autotest_common.sh@1194 -- # return 0 00:07:39.692 19:14:26 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:39.692 19:14:26 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:39.692 19:14:26 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:39.692 19:14:26 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:39.692 19:14:26 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:39.692 19:14:26 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:39.692 19:14:26 -- setup/common.sh@80 -- # echo 536870912 00:07:39.692 19:14:26 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:39.692 19:14:26 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:39.692 19:14:26 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:39.692 19:14:26 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:39.692 19:14:26 -- target/filesystem.sh@69 -- # partprobe 00:07:39.692 19:14:26 -- target/filesystem.sh@70 -- # sleep 1 00:07:41.064 19:14:27 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:41.064 19:14:27 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:41.064 19:14:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:41.064 19:14:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.064 19:14:27 -- common/autotest_common.sh@10 -- # set +x 00:07:41.064 ************************************ 00:07:41.064 START TEST filesystem_ext4 00:07:41.064 ************************************ 00:07:41.064 19:14:27 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:41.064 19:14:27 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:41.064 19:14:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:41.064 19:14:27 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:41.064 19:14:27 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:41.064 19:14:27 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:41.064 19:14:27 -- common/autotest_common.sh@914 -- # local i=0 00:07:41.064 19:14:27 -- common/autotest_common.sh@915 -- # local force 00:07:41.064 19:14:27 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:41.064 19:14:27 -- common/autotest_common.sh@918 -- # force=-F 00:07:41.064 19:14:27 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:41.064 mke2fs 1.46.5 (30-Dec-2021) 00:07:41.065 Discarding device blocks: 0/522240 done 00:07:41.065 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:41.065 Filesystem UUID: e9e3efad-8d08-49e3-8c37-dc93d6ff5b9a 00:07:41.065 Superblock backups stored on blocks: 00:07:41.065 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:41.065 00:07:41.065 Allocating group tables: 0/64 done 00:07:41.065 Writing inode tables: 0/64 done 00:07:41.065 Creating journal (8192 blocks): done 00:07:41.065 Writing superblocks and filesystem accounting information: 0/64 done 00:07:41.065 00:07:41.065 19:14:27 -- common/autotest_common.sh@931 -- # return 0 00:07:41.065 19:14:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:41.065 19:14:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:41.065 19:14:27 -- target/filesystem.sh@25 -- # sync 00:07:41.065 19:14:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:41.065 19:14:27 -- target/filesystem.sh@27 -- # sync 00:07:41.065 19:14:27 -- target/filesystem.sh@29 -- # i=0 00:07:41.065 19:14:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:41.065 19:14:27 -- target/filesystem.sh@37 -- # kill -0 2910937 00:07:41.065 19:14:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:41.065 19:14:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:41.065 19:14:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:41.065 19:14:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:41.065 00:07:41.065 real 0m0.194s 00:07:41.065 user 0m0.025s 00:07:41.065 sys 0m0.078s 00:07:41.065 19:14:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:41.065 19:14:28 -- common/autotest_common.sh@10 -- # set +x 00:07:41.065 ************************************ 00:07:41.065 END TEST filesystem_ext4 00:07:41.065 ************************************ 00:07:41.065 19:14:28 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:41.065 19:14:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:41.065 19:14:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.065 19:14:28 -- common/autotest_common.sh@10 -- # set +x 00:07:41.322 ************************************ 00:07:41.322 START TEST filesystem_btrfs 00:07:41.322 ************************************ 00:07:41.322 19:14:28 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:41.322 19:14:28 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:41.322 19:14:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:41.322 19:14:28 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:41.322 19:14:28 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:41.322 19:14:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:41.322 19:14:28 -- common/autotest_common.sh@914 -- # local i=0 00:07:41.323 19:14:28 -- common/autotest_common.sh@915 -- # local force 00:07:41.323 19:14:28 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:41.323 19:14:28 -- common/autotest_common.sh@920 -- # force=-f 00:07:41.323 19:14:28 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:41.580 btrfs-progs v6.6.2 00:07:41.580 See https://btrfs.readthedocs.io for more information. 00:07:41.580 00:07:41.580 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:41.580 NOTE: several default settings have changed in version 5.15, please make sure 00:07:41.580 this does not affect your deployments: 00:07:41.580 - DUP for metadata (-m dup) 00:07:41.580 - enabled no-holes (-O no-holes) 00:07:41.580 - enabled free-space-tree (-R free-space-tree) 00:07:41.580 00:07:41.580 Label: (null) 00:07:41.580 UUID: 0d579ece-847b-496a-8a56-4a08aa3cf5e7 00:07:41.580 Node size: 16384 00:07:41.580 Sector size: 4096 00:07:41.580 Filesystem size: 510.00MiB 00:07:41.580 Block group profiles: 00:07:41.580 Data: single 8.00MiB 00:07:41.580 Metadata: DUP 32.00MiB 00:07:41.580 System: DUP 8.00MiB 00:07:41.580 SSD detected: yes 00:07:41.581 Zoned device: no 00:07:41.581 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:41.581 Runtime features: free-space-tree 00:07:41.581 Checksum: crc32c 00:07:41.581 Number of devices: 1 00:07:41.581 Devices: 00:07:41.581 ID SIZE PATH 00:07:41.581 1 510.00MiB /dev/nvme0n1p1 00:07:41.581 00:07:41.581 19:14:28 -- common/autotest_common.sh@931 -- # return 0 00:07:41.581 19:14:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:41.581 19:14:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:41.581 19:14:28 -- target/filesystem.sh@25 -- # sync 00:07:41.581 19:14:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:41.581 19:14:28 -- target/filesystem.sh@27 -- # sync 00:07:41.581 19:14:28 -- target/filesystem.sh@29 -- # i=0 00:07:41.581 19:14:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:41.581 19:14:28 -- target/filesystem.sh@37 -- # kill -0 2910937 00:07:41.581 19:14:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:41.581 19:14:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:41.581 19:14:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:41.581 19:14:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:41.581 00:07:41.581 real 0m0.311s 00:07:41.581 user 0m0.036s 00:07:41.581 sys 0m0.168s 00:07:41.581 19:14:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:41.581 19:14:28 -- common/autotest_common.sh@10 -- # set +x 00:07:41.581 ************************************ 00:07:41.581 END TEST filesystem_btrfs 00:07:41.581 ************************************ 00:07:41.581 19:14:28 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:41.581 19:14:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:41.581 19:14:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.581 19:14:28 -- common/autotest_common.sh@10 -- # set +x 00:07:41.838 ************************************ 00:07:41.838 START TEST filesystem_xfs 00:07:41.838 ************************************ 00:07:41.838 19:14:28 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:07:41.838 19:14:28 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:41.839 19:14:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:41.839 19:14:28 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:41.839 19:14:28 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:41.839 19:14:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:41.839 19:14:28 -- common/autotest_common.sh@914 -- # local i=0 00:07:41.839 19:14:28 -- common/autotest_common.sh@915 -- # local force 00:07:41.839 19:14:28 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:41.839 19:14:28 -- common/autotest_common.sh@920 -- # force=-f 00:07:41.839 19:14:28 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:42.097 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:42.097 = sectsz=512 attr=2, projid32bit=1 00:07:42.097 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:42.097 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:42.097 data = bsize=4096 blocks=130560, imaxpct=25 00:07:42.097 = sunit=0 swidth=0 blks 00:07:42.097 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:42.097 log =internal log bsize=4096 blocks=16384, version=2 00:07:42.097 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:42.097 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:42.097 Discarding blocks...Done. 00:07:42.097 19:14:28 -- common/autotest_common.sh@931 -- # return 0 00:07:42.097 19:14:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:42.097 19:14:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:42.097 19:14:28 -- target/filesystem.sh@25 -- # sync 00:07:42.097 19:14:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:42.097 19:14:28 -- target/filesystem.sh@27 -- # sync 00:07:42.097 19:14:28 -- target/filesystem.sh@29 -- # i=0 00:07:42.097 19:14:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:42.097 19:14:28 -- target/filesystem.sh@37 -- # kill -0 2910937 00:07:42.097 19:14:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:42.097 19:14:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:42.097 19:14:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:42.097 19:14:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:42.097 00:07:42.097 real 0m0.250s 00:07:42.097 user 0m0.023s 00:07:42.097 sys 0m0.115s 00:07:42.097 19:14:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:42.097 19:14:29 -- common/autotest_common.sh@10 -- # set +x 00:07:42.097 ************************************ 00:07:42.097 END TEST filesystem_xfs 00:07:42.097 ************************************ 00:07:42.097 19:14:29 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:42.097 19:14:29 -- target/filesystem.sh@93 -- # sync 00:07:42.097 19:14:29 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:43.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:43.030 19:14:30 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:43.030 19:14:30 -- common/autotest_common.sh@1205 -- # local i=0 00:07:43.030 19:14:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:43.030 19:14:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:43.030 19:14:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:43.030 19:14:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:43.030 19:14:30 -- common/autotest_common.sh@1217 -- # return 0 00:07:43.030 19:14:30 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:43.030 19:14:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:43.030 19:14:30 -- common/autotest_common.sh@10 -- # set +x 00:07:43.288 19:14:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:43.288 19:14:30 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:43.288 19:14:30 -- target/filesystem.sh@101 -- # killprocess 2910937 00:07:43.288 19:14:30 -- common/autotest_common.sh@936 -- # '[' -z 2910937 ']' 00:07:43.288 19:14:30 -- common/autotest_common.sh@940 -- # kill -0 2910937 00:07:43.288 19:14:30 -- common/autotest_common.sh@941 -- # uname 00:07:43.288 19:14:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:43.288 19:14:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2910937 00:07:43.288 19:14:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:43.288 19:14:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:43.288 19:14:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2910937' 00:07:43.288 killing process with pid 2910937 00:07:43.288 19:14:30 -- common/autotest_common.sh@955 -- # kill 2910937 00:07:43.288 19:14:30 -- common/autotest_common.sh@960 -- # wait 2910937 00:07:43.288 [2024-04-24 19:14:30.170932] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:43.546 19:14:30 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:43.546 00:07:43.546 real 0m8.495s 00:07:43.546 user 0m33.086s 00:07:43.546 sys 0m1.573s 00:07:43.546 19:14:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:43.546 19:14:30 -- common/autotest_common.sh@10 -- # set +x 00:07:43.546 ************************************ 00:07:43.546 END TEST nvmf_filesystem_no_in_capsule 00:07:43.546 ************************************ 00:07:43.805 19:14:30 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:43.805 19:14:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:43.805 19:14:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.805 19:14:30 -- common/autotest_common.sh@10 -- # set +x 00:07:43.805 ************************************ 00:07:43.805 START TEST nvmf_filesystem_in_capsule 00:07:43.805 ************************************ 00:07:43.805 19:14:30 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:07:43.805 19:14:30 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:43.805 19:14:30 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:43.805 19:14:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:43.805 19:14:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:43.805 19:14:30 -- common/autotest_common.sh@10 -- # set +x 00:07:43.805 19:14:30 -- nvmf/common.sh@470 -- # nvmfpid=2912358 00:07:43.805 19:14:30 -- nvmf/common.sh@471 -- # waitforlisten 2912358 00:07:43.805 19:14:30 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:43.805 19:14:30 -- common/autotest_common.sh@817 -- # '[' -z 2912358 ']' 00:07:43.805 19:14:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:43.805 19:14:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:43.805 19:14:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:43.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:43.805 19:14:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:43.805 19:14:30 -- common/autotest_common.sh@10 -- # set +x 00:07:43.805 [2024-04-24 19:14:30.825326] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:43.805 [2024-04-24 19:14:30.825383] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:44.064 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.064 [2024-04-24 19:14:30.899210] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.064 [2024-04-24 19:14:30.987095] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:44.064 [2024-04-24 19:14:30.987138] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:44.064 [2024-04-24 19:14:30.987148] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:44.064 [2024-04-24 19:14:30.987156] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:44.064 [2024-04-24 19:14:30.987164] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:44.064 [2024-04-24 19:14:30.987262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.064 [2024-04-24 19:14:30.987362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.064 [2024-04-24 19:14:30.987439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.064 [2024-04-24 19:14:30.987440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.997 19:14:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:44.997 19:14:31 -- common/autotest_common.sh@850 -- # return 0 00:07:44.997 19:14:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:44.997 19:14:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:44.997 19:14:31 -- common/autotest_common.sh@10 -- # set +x 00:07:44.997 19:14:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:44.997 19:14:31 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:44.997 19:14:31 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:07:44.997 19:14:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:44.997 19:14:31 -- common/autotest_common.sh@10 -- # set +x 00:07:44.997 [2024-04-24 19:14:31.724578] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1438240/0x143c730) succeed. 00:07:44.997 [2024-04-24 19:14:31.735094] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1439880/0x147ddc0) succeed. 00:07:44.997 19:14:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:44.997 19:14:31 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:44.997 19:14:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:44.997 19:14:31 -- common/autotest_common.sh@10 -- # set +x 00:07:44.997 Malloc1 00:07:44.997 19:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:44.997 19:14:32 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:44.997 19:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:44.997 19:14:32 -- common/autotest_common.sh@10 -- # set +x 00:07:44.997 19:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:44.997 19:14:32 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:44.997 19:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:44.997 19:14:32 -- common/autotest_common.sh@10 -- # set +x 00:07:45.254 19:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:45.254 19:14:32 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:45.254 19:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:45.254 19:14:32 -- common/autotest_common.sh@10 -- # set +x 00:07:45.254 [2024-04-24 19:14:32.030403] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:45.254 19:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:45.254 19:14:32 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:45.254 19:14:32 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:07:45.254 19:14:32 -- common/autotest_common.sh@1365 -- # local bdev_info 00:07:45.254 19:14:32 -- common/autotest_common.sh@1366 -- # local bs 00:07:45.254 19:14:32 -- common/autotest_common.sh@1367 -- # local nb 00:07:45.254 19:14:32 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:45.254 19:14:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:45.254 19:14:32 -- common/autotest_common.sh@10 -- # set +x 00:07:45.254 19:14:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:45.254 19:14:32 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:07:45.254 { 00:07:45.254 "name": "Malloc1", 00:07:45.254 "aliases": [ 00:07:45.254 "4a6cb876-c031-4d77-887d-964b43209a87" 00:07:45.254 ], 00:07:45.254 "product_name": "Malloc disk", 00:07:45.254 "block_size": 512, 00:07:45.254 "num_blocks": 1048576, 00:07:45.254 "uuid": "4a6cb876-c031-4d77-887d-964b43209a87", 00:07:45.254 "assigned_rate_limits": { 00:07:45.254 "rw_ios_per_sec": 0, 00:07:45.255 "rw_mbytes_per_sec": 0, 00:07:45.255 "r_mbytes_per_sec": 0, 00:07:45.255 "w_mbytes_per_sec": 0 00:07:45.255 }, 00:07:45.255 "claimed": true, 00:07:45.255 "claim_type": "exclusive_write", 00:07:45.255 "zoned": false, 00:07:45.255 "supported_io_types": { 00:07:45.255 "read": true, 00:07:45.255 "write": true, 00:07:45.255 "unmap": true, 00:07:45.255 "write_zeroes": true, 00:07:45.255 "flush": true, 00:07:45.255 "reset": true, 00:07:45.255 "compare": false, 00:07:45.255 "compare_and_write": false, 00:07:45.255 "abort": true, 00:07:45.255 "nvme_admin": false, 00:07:45.255 "nvme_io": false 00:07:45.255 }, 00:07:45.255 "memory_domains": [ 00:07:45.255 { 00:07:45.255 "dma_device_id": "system", 00:07:45.255 "dma_device_type": 1 00:07:45.255 }, 00:07:45.255 { 00:07:45.255 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:45.255 "dma_device_type": 2 00:07:45.255 } 00:07:45.255 ], 00:07:45.255 "driver_specific": {} 00:07:45.255 } 00:07:45.255 ]' 00:07:45.255 19:14:32 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:07:45.255 19:14:32 -- common/autotest_common.sh@1369 -- # bs=512 00:07:45.255 19:14:32 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:07:45.255 19:14:32 -- common/autotest_common.sh@1370 -- # nb=1048576 00:07:45.255 19:14:32 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:07:45.255 19:14:32 -- common/autotest_common.sh@1374 -- # echo 512 00:07:45.255 19:14:32 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:45.255 19:14:32 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:46.186 19:14:33 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:46.186 19:14:33 -- common/autotest_common.sh@1184 -- # local i=0 00:07:46.186 19:14:33 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:46.186 19:14:33 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:46.186 19:14:33 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:48.712 19:14:35 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:48.712 19:14:35 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:48.712 19:14:35 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:48.712 19:14:35 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:48.712 19:14:35 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:48.712 19:14:35 -- common/autotest_common.sh@1194 -- # return 0 00:07:48.712 19:14:35 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:48.712 19:14:35 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:48.712 19:14:35 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:48.712 19:14:35 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:48.712 19:14:35 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:48.712 19:14:35 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:48.712 19:14:35 -- setup/common.sh@80 -- # echo 536870912 00:07:48.712 19:14:35 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:48.712 19:14:35 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:48.712 19:14:35 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:48.712 19:14:35 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:48.712 19:14:35 -- target/filesystem.sh@69 -- # partprobe 00:07:48.712 19:14:35 -- target/filesystem.sh@70 -- # sleep 1 00:07:49.645 19:14:36 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:49.645 19:14:36 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:49.645 19:14:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:49.645 19:14:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.645 19:14:36 -- common/autotest_common.sh@10 -- # set +x 00:07:49.645 ************************************ 00:07:49.645 START TEST filesystem_in_capsule_ext4 00:07:49.645 ************************************ 00:07:49.645 19:14:36 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:49.645 19:14:36 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:49.645 19:14:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:49.645 19:14:36 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:49.645 19:14:36 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:49.645 19:14:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:49.645 19:14:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:49.645 19:14:36 -- common/autotest_common.sh@915 -- # local force 00:07:49.645 19:14:36 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:49.645 19:14:36 -- common/autotest_common.sh@918 -- # force=-F 00:07:49.645 19:14:36 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:49.645 mke2fs 1.46.5 (30-Dec-2021) 00:07:49.645 Discarding device blocks: 0/522240 done 00:07:49.645 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:49.645 Filesystem UUID: aa6a4fe0-d0d8-4e57-bcb4-412f54ba1462 00:07:49.645 Superblock backups stored on blocks: 00:07:49.645 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:49.645 00:07:49.645 Allocating group tables: 0/64 done 00:07:49.646 Writing inode tables: 0/64 done 00:07:49.646 Creating journal (8192 blocks): done 00:07:49.646 Writing superblocks and filesystem accounting information: 0/64 done 00:07:49.646 00:07:49.646 19:14:36 -- common/autotest_common.sh@931 -- # return 0 00:07:49.646 19:14:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:49.646 19:14:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:49.646 19:14:36 -- target/filesystem.sh@25 -- # sync 00:07:49.646 19:14:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:49.646 19:14:36 -- target/filesystem.sh@27 -- # sync 00:07:49.646 19:14:36 -- target/filesystem.sh@29 -- # i=0 00:07:49.646 19:14:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:49.903 19:14:36 -- target/filesystem.sh@37 -- # kill -0 2912358 00:07:49.903 19:14:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:49.904 19:14:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:49.904 19:14:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:49.904 19:14:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:49.904 00:07:49.904 real 0m0.196s 00:07:49.904 user 0m0.024s 00:07:49.904 sys 0m0.076s 00:07:49.904 19:14:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:49.904 19:14:36 -- common/autotest_common.sh@10 -- # set +x 00:07:49.904 ************************************ 00:07:49.904 END TEST filesystem_in_capsule_ext4 00:07:49.904 ************************************ 00:07:49.904 19:14:36 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:49.904 19:14:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:49.904 19:14:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.904 19:14:36 -- common/autotest_common.sh@10 -- # set +x 00:07:50.161 ************************************ 00:07:50.161 START TEST filesystem_in_capsule_btrfs 00:07:50.161 ************************************ 00:07:50.161 19:14:36 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:50.161 19:14:36 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:50.161 19:14:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:50.161 19:14:36 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:50.161 19:14:36 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:50.161 19:14:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:50.161 19:14:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:50.161 19:14:36 -- common/autotest_common.sh@915 -- # local force 00:07:50.161 19:14:36 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:50.161 19:14:36 -- common/autotest_common.sh@920 -- # force=-f 00:07:50.161 19:14:36 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:50.161 btrfs-progs v6.6.2 00:07:50.161 See https://btrfs.readthedocs.io for more information. 00:07:50.161 00:07:50.161 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:50.161 NOTE: several default settings have changed in version 5.15, please make sure 00:07:50.161 this does not affect your deployments: 00:07:50.161 - DUP for metadata (-m dup) 00:07:50.161 - enabled no-holes (-O no-holes) 00:07:50.161 - enabled free-space-tree (-R free-space-tree) 00:07:50.161 00:07:50.161 Label: (null) 00:07:50.161 UUID: 4ac10fa0-3067-446e-9fb1-261ad2e754df 00:07:50.161 Node size: 16384 00:07:50.161 Sector size: 4096 00:07:50.161 Filesystem size: 510.00MiB 00:07:50.161 Block group profiles: 00:07:50.161 Data: single 8.00MiB 00:07:50.161 Metadata: DUP 32.00MiB 00:07:50.161 System: DUP 8.00MiB 00:07:50.161 SSD detected: yes 00:07:50.161 Zoned device: no 00:07:50.161 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:50.162 Runtime features: free-space-tree 00:07:50.162 Checksum: crc32c 00:07:50.162 Number of devices: 1 00:07:50.162 Devices: 00:07:50.162 ID SIZE PATH 00:07:50.162 1 510.00MiB /dev/nvme0n1p1 00:07:50.162 00:07:50.162 19:14:37 -- common/autotest_common.sh@931 -- # return 0 00:07:50.162 19:14:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:50.162 19:14:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:50.162 19:14:37 -- target/filesystem.sh@25 -- # sync 00:07:50.162 19:14:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:50.162 19:14:37 -- target/filesystem.sh@27 -- # sync 00:07:50.162 19:14:37 -- target/filesystem.sh@29 -- # i=0 00:07:50.162 19:14:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:50.162 19:14:37 -- target/filesystem.sh@37 -- # kill -0 2912358 00:07:50.162 19:14:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:50.162 19:14:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:50.420 19:14:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:50.420 19:14:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:50.420 00:07:50.420 real 0m0.277s 00:07:50.420 user 0m0.025s 00:07:50.420 sys 0m0.139s 00:07:50.420 19:14:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:50.420 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:07:50.420 ************************************ 00:07:50.420 END TEST filesystem_in_capsule_btrfs 00:07:50.420 ************************************ 00:07:50.420 19:14:37 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:50.421 19:14:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:50.421 19:14:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.421 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:07:50.421 ************************************ 00:07:50.421 START TEST filesystem_in_capsule_xfs 00:07:50.421 ************************************ 00:07:50.421 19:14:37 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:07:50.421 19:14:37 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:50.421 19:14:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:50.421 19:14:37 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:50.421 19:14:37 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:50.421 19:14:37 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:50.421 19:14:37 -- common/autotest_common.sh@914 -- # local i=0 00:07:50.421 19:14:37 -- common/autotest_common.sh@915 -- # local force 00:07:50.421 19:14:37 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:50.421 19:14:37 -- common/autotest_common.sh@920 -- # force=-f 00:07:50.421 19:14:37 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:50.679 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:50.679 = sectsz=512 attr=2, projid32bit=1 00:07:50.679 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:50.679 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:50.679 data = bsize=4096 blocks=130560, imaxpct=25 00:07:50.679 = sunit=0 swidth=0 blks 00:07:50.679 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:50.679 log =internal log bsize=4096 blocks=16384, version=2 00:07:50.679 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:50.679 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:50.679 Discarding blocks...Done. 00:07:50.679 19:14:37 -- common/autotest_common.sh@931 -- # return 0 00:07:50.679 19:14:37 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:50.679 19:14:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:50.679 19:14:37 -- target/filesystem.sh@25 -- # sync 00:07:50.679 19:14:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:50.679 19:14:37 -- target/filesystem.sh@27 -- # sync 00:07:50.679 19:14:37 -- target/filesystem.sh@29 -- # i=0 00:07:50.679 19:14:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:50.679 19:14:37 -- target/filesystem.sh@37 -- # kill -0 2912358 00:07:50.679 19:14:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:50.679 19:14:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:50.679 19:14:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:50.679 19:14:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:50.679 00:07:50.679 real 0m0.213s 00:07:50.679 user 0m0.036s 00:07:50.679 sys 0m0.071s 00:07:50.679 19:14:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:50.679 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:07:50.679 ************************************ 00:07:50.679 END TEST filesystem_in_capsule_xfs 00:07:50.679 ************************************ 00:07:50.679 19:14:37 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:50.938 19:14:37 -- target/filesystem.sh@93 -- # sync 00:07:50.938 19:14:37 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:51.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.883 19:14:38 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:51.883 19:14:38 -- common/autotest_common.sh@1205 -- # local i=0 00:07:51.883 19:14:38 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:51.883 19:14:38 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:51.883 19:14:38 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:51.883 19:14:38 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:51.883 19:14:38 -- common/autotest_common.sh@1217 -- # return 0 00:07:51.883 19:14:38 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:51.883 19:14:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:51.883 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:07:51.883 19:14:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:51.883 19:14:38 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:51.883 19:14:38 -- target/filesystem.sh@101 -- # killprocess 2912358 00:07:51.883 19:14:38 -- common/autotest_common.sh@936 -- # '[' -z 2912358 ']' 00:07:51.883 19:14:38 -- common/autotest_common.sh@940 -- # kill -0 2912358 00:07:51.883 19:14:38 -- common/autotest_common.sh@941 -- # uname 00:07:51.883 19:14:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:51.883 19:14:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2912358 00:07:51.883 19:14:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:51.883 19:14:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:51.883 19:14:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2912358' 00:07:51.883 killing process with pid 2912358 00:07:51.883 19:14:38 -- common/autotest_common.sh@955 -- # kill 2912358 00:07:51.883 19:14:38 -- common/autotest_common.sh@960 -- # wait 2912358 00:07:51.883 [2024-04-24 19:14:38.844598] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:52.450 19:14:39 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:52.450 00:07:52.450 real 0m8.472s 00:07:52.450 user 0m32.958s 00:07:52.450 sys 0m1.509s 00:07:52.450 19:14:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:52.450 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:07:52.450 ************************************ 00:07:52.450 END TEST nvmf_filesystem_in_capsule 00:07:52.450 ************************************ 00:07:52.450 19:14:39 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:52.450 19:14:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:52.450 19:14:39 -- nvmf/common.sh@117 -- # sync 00:07:52.450 19:14:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:52.450 19:14:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:52.450 19:14:39 -- nvmf/common.sh@120 -- # set +e 00:07:52.450 19:14:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:52.450 19:14:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:52.450 rmmod nvme_rdma 00:07:52.450 rmmod nvme_fabrics 00:07:52.450 19:14:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:52.450 19:14:39 -- nvmf/common.sh@124 -- # set -e 00:07:52.450 19:14:39 -- nvmf/common.sh@125 -- # return 0 00:07:52.450 19:14:39 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:07:52.450 19:14:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:52.450 19:14:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:52.450 00:07:52.450 real 0m23.364s 00:07:52.450 user 1m7.942s 00:07:52.450 sys 0m7.721s 00:07:52.450 19:14:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:52.450 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:07:52.450 ************************************ 00:07:52.450 END TEST nvmf_filesystem 00:07:52.450 ************************************ 00:07:52.450 19:14:39 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:52.450 19:14:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:52.450 19:14:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.450 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:07:52.709 ************************************ 00:07:52.709 START TEST nvmf_discovery 00:07:52.709 ************************************ 00:07:52.709 19:14:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:52.709 * Looking for test storage... 00:07:52.709 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:52.709 19:14:39 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.709 19:14:39 -- nvmf/common.sh@7 -- # uname -s 00:07:52.709 19:14:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.709 19:14:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.709 19:14:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.709 19:14:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.709 19:14:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.709 19:14:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.709 19:14:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.709 19:14:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.709 19:14:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.709 19:14:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.709 19:14:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:07:52.709 19:14:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:07:52.709 19:14:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.709 19:14:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.709 19:14:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.709 19:14:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:52.709 19:14:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:52.709 19:14:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.709 19:14:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.709 19:14:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.709 19:14:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.709 19:14:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.709 19:14:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.709 19:14:39 -- paths/export.sh@5 -- # export PATH 00:07:52.709 19:14:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.709 19:14:39 -- nvmf/common.sh@47 -- # : 0 00:07:52.709 19:14:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:52.709 19:14:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:52.709 19:14:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:52.709 19:14:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.709 19:14:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.709 19:14:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:52.709 19:14:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:52.709 19:14:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:52.709 19:14:39 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:52.709 19:14:39 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:52.709 19:14:39 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:52.709 19:14:39 -- target/discovery.sh@15 -- # hash nvme 00:07:52.709 19:14:39 -- target/discovery.sh@20 -- # nvmftestinit 00:07:52.709 19:14:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:52.709 19:14:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.709 19:14:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:52.709 19:14:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:52.709 19:14:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:52.709 19:14:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.709 19:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.709 19:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.709 19:14:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:52.709 19:14:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:52.709 19:14:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:52.709 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:07:59.274 19:14:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:59.274 19:14:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:59.274 19:14:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:59.274 19:14:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:59.274 19:14:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:59.274 19:14:46 -- nvmf/common.sh@295 -- # net_devs=() 00:07:59.274 19:14:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@296 -- # e810=() 00:07:59.274 19:14:46 -- nvmf/common.sh@296 -- # local -ga e810 00:07:59.274 19:14:46 -- nvmf/common.sh@297 -- # x722=() 00:07:59.274 19:14:46 -- nvmf/common.sh@297 -- # local -ga x722 00:07:59.274 19:14:46 -- nvmf/common.sh@298 -- # mlx=() 00:07:59.274 19:14:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:59.274 19:14:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:59.274 19:14:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:59.274 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:59.274 19:14:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:59.274 19:14:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:59.274 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:59.274 19:14:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:59.274 19:14:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.274 19:14:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.274 19:14:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:59.274 Found net devices under 0000:18:00.0: mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.274 19:14:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.274 19:14:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:59.274 Found net devices under 0000:18:00.1: mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.274 19:14:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:59.274 19:14:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:59.274 19:14:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:59.274 19:14:46 -- nvmf/common.sh@58 -- # uname 00:07:59.274 19:14:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:59.274 19:14:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:59.274 19:14:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:59.274 19:14:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:59.274 19:14:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:59.274 19:14:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:59.274 19:14:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:59.274 19:14:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:59.274 19:14:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:59.274 19:14:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:59.274 19:14:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:59.274 19:14:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:59.274 19:14:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:59.274 19:14:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@105 -- # continue 2 00:07:59.274 19:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@105 -- # continue 2 00:07:59.274 19:14:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:59.274 19:14:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:59.274 19:14:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:59.274 19:14:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:59.274 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:59.274 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:07:59.274 altname enp24s0f0np0 00:07:59.274 altname ens785f0np0 00:07:59.274 inet 192.168.100.8/24 scope global mlx_0_0 00:07:59.274 valid_lft forever preferred_lft forever 00:07:59.274 19:14:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:59.274 19:14:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:59.274 19:14:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:59.274 19:14:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:59.274 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:59.274 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:07:59.274 altname enp24s0f1np1 00:07:59.274 altname ens785f1np1 00:07:59.274 inet 192.168.100.9/24 scope global mlx_0_1 00:07:59.274 valid_lft forever preferred_lft forever 00:07:59.274 19:14:46 -- nvmf/common.sh@411 -- # return 0 00:07:59.274 19:14:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:59.274 19:14:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:59.274 19:14:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:59.274 19:14:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:59.274 19:14:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:59.274 19:14:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:59.274 19:14:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:59.274 19:14:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:59.274 19:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@105 -- # continue 2 00:07:59.274 19:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:59.274 19:14:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:59.274 19:14:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@105 -- # continue 2 00:07:59.274 19:14:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:59.274 19:14:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:59.274 19:14:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:59.274 19:14:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:59.274 19:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:59.274 19:14:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:59.274 192.168.100.9' 00:07:59.274 19:14:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:59.274 192.168.100.9' 00:07:59.274 19:14:46 -- nvmf/common.sh@446 -- # head -n 1 00:07:59.274 19:14:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:59.274 19:14:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:59.274 192.168.100.9' 00:07:59.274 19:14:46 -- nvmf/common.sh@447 -- # head -n 1 00:07:59.274 19:14:46 -- nvmf/common.sh@447 -- # tail -n +2 00:07:59.274 19:14:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:59.274 19:14:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:59.274 19:14:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:59.274 19:14:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:59.274 19:14:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:59.274 19:14:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:59.533 19:14:46 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:59.533 19:14:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:59.533 19:14:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:59.533 19:14:46 -- common/autotest_common.sh@10 -- # set +x 00:07:59.533 19:14:46 -- nvmf/common.sh@470 -- # nvmfpid=2916669 00:07:59.533 19:14:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:59.533 19:14:46 -- nvmf/common.sh@471 -- # waitforlisten 2916669 00:07:59.533 19:14:46 -- common/autotest_common.sh@817 -- # '[' -z 2916669 ']' 00:07:59.533 19:14:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:59.533 19:14:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:59.533 19:14:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:59.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:59.533 19:14:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:59.533 19:14:46 -- common/autotest_common.sh@10 -- # set +x 00:07:59.533 [2024-04-24 19:14:46.348186] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:07:59.533 [2024-04-24 19:14:46.348249] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:59.533 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.533 [2024-04-24 19:14:46.420938] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:59.533 [2024-04-24 19:14:46.514875] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:59.533 [2024-04-24 19:14:46.514917] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:59.533 [2024-04-24 19:14:46.514927] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:59.533 [2024-04-24 19:14:46.514936] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:59.533 [2024-04-24 19:14:46.514944] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:59.533 [2024-04-24 19:14:46.514997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:59.533 [2024-04-24 19:14:46.515090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:59.533 [2024-04-24 19:14:46.515166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:59.533 [2024-04-24 19:14:46.515167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.467 19:14:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:00.467 19:14:47 -- common/autotest_common.sh@850 -- # return 0 00:08:00.467 19:14:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:00.467 19:14:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:00.467 19:14:47 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 [2024-04-24 19:14:47.242869] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1441240/0x1445730) succeed. 00:08:00.467 [2024-04-24 19:14:47.253322] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1442880/0x1486dc0) succeed. 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@26 -- # seq 1 4 00:08:00.467 19:14:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:00.467 19:14:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 Null1 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 [2024-04-24 19:14:47.427244] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:00.467 19:14:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 Null2 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:00.467 19:14:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 Null3 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.467 19:14:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:00.467 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.467 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.467 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:00.725 19:14:47 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 Null4 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.725 19:14:47 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:08:00.725 00:08:00.725 Discovery Log Number of Records 6, Generation counter 6 00:08:00.725 =====Discovery Log Entry 0====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: current discovery subsystem 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4420 00:08:00.725 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: explicit discovery connections, duplicate discovery information 00:08:00.725 rdma_prtype: not specified 00:08:00.725 rdma_qptype: connected 00:08:00.725 rdma_cms: rdma-cm 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 =====Discovery Log Entry 1====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: nvme subsystem 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4420 00:08:00.725 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: none 00:08:00.725 rdma_prtype: not specified 00:08:00.725 rdma_qptype: connected 00:08:00.725 rdma_cms: rdma-cm 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 =====Discovery Log Entry 2====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: nvme subsystem 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4420 00:08:00.725 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: none 00:08:00.725 rdma_prtype: not specified 00:08:00.725 rdma_qptype: connected 00:08:00.725 rdma_cms: rdma-cm 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 =====Discovery Log Entry 3====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: nvme subsystem 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4420 00:08:00.725 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: none 00:08:00.725 rdma_prtype: not specified 00:08:00.725 rdma_qptype: connected 00:08:00.725 rdma_cms: rdma-cm 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 =====Discovery Log Entry 4====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: nvme subsystem 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4420 00:08:00.725 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: none 00:08:00.725 rdma_prtype: not specified 00:08:00.725 rdma_qptype: connected 00:08:00.725 rdma_cms: rdma-cm 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 =====Discovery Log Entry 5====== 00:08:00.725 trtype: rdma 00:08:00.725 adrfam: ipv4 00:08:00.725 subtype: discovery subsystem referral 00:08:00.725 treq: not required 00:08:00.725 portid: 0 00:08:00.725 trsvcid: 4430 00:08:00.725 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:00.725 traddr: 192.168.100.8 00:08:00.725 eflags: none 00:08:00.725 rdma_prtype: unrecognized 00:08:00.725 rdma_qptype: unrecognized 00:08:00.725 rdma_cms: unrecognized 00:08:00.725 rdma_pkey: 0x0000 00:08:00.725 19:14:47 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:00.725 Perform nvmf subsystem discovery via RPC 00:08:00.725 19:14:47 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:00.725 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.725 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.725 [2024-04-24 19:14:47.647712] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:00.725 [ 00:08:00.725 { 00:08:00.725 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:00.725 "subtype": "Discovery", 00:08:00.725 "listen_addresses": [ 00:08:00.725 { 00:08:00.725 "transport": "RDMA", 00:08:00.725 "trtype": "RDMA", 00:08:00.725 "adrfam": "IPv4", 00:08:00.725 "traddr": "192.168.100.8", 00:08:00.725 "trsvcid": "4420" 00:08:00.726 } 00:08:00.726 ], 00:08:00.726 "allow_any_host": true, 00:08:00.726 "hosts": [] 00:08:00.726 }, 00:08:00.726 { 00:08:00.726 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:00.726 "subtype": "NVMe", 00:08:00.726 "listen_addresses": [ 00:08:00.726 { 00:08:00.726 "transport": "RDMA", 00:08:00.726 "trtype": "RDMA", 00:08:00.726 "adrfam": "IPv4", 00:08:00.726 "traddr": "192.168.100.8", 00:08:00.726 "trsvcid": "4420" 00:08:00.726 } 00:08:00.726 ], 00:08:00.726 "allow_any_host": true, 00:08:00.726 "hosts": [], 00:08:00.726 "serial_number": "SPDK00000000000001", 00:08:00.726 "model_number": "SPDK bdev Controller", 00:08:00.726 "max_namespaces": 32, 00:08:00.726 "min_cntlid": 1, 00:08:00.726 "max_cntlid": 65519, 00:08:00.726 "namespaces": [ 00:08:00.726 { 00:08:00.726 "nsid": 1, 00:08:00.726 "bdev_name": "Null1", 00:08:00.726 "name": "Null1", 00:08:00.726 "nguid": "04C974AD11184AD982F727923D5C7DD8", 00:08:00.726 "uuid": "04c974ad-1118-4ad9-82f7-27923d5c7dd8" 00:08:00.726 } 00:08:00.726 ] 00:08:00.726 }, 00:08:00.726 { 00:08:00.726 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:00.726 "subtype": "NVMe", 00:08:00.726 "listen_addresses": [ 00:08:00.726 { 00:08:00.726 "transport": "RDMA", 00:08:00.726 "trtype": "RDMA", 00:08:00.726 "adrfam": "IPv4", 00:08:00.726 "traddr": "192.168.100.8", 00:08:00.726 "trsvcid": "4420" 00:08:00.726 } 00:08:00.726 ], 00:08:00.726 "allow_any_host": true, 00:08:00.726 "hosts": [], 00:08:00.726 "serial_number": "SPDK00000000000002", 00:08:00.726 "model_number": "SPDK bdev Controller", 00:08:00.726 "max_namespaces": 32, 00:08:00.726 "min_cntlid": 1, 00:08:00.726 "max_cntlid": 65519, 00:08:00.726 "namespaces": [ 00:08:00.726 { 00:08:00.726 "nsid": 1, 00:08:00.726 "bdev_name": "Null2", 00:08:00.726 "name": "Null2", 00:08:00.726 "nguid": "9222F2A18AB14F7AAFE8C52639AEF769", 00:08:00.726 "uuid": "9222f2a1-8ab1-4f7a-afe8-c52639aef769" 00:08:00.726 } 00:08:00.726 ] 00:08:00.726 }, 00:08:00.726 { 00:08:00.726 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:00.726 "subtype": "NVMe", 00:08:00.726 "listen_addresses": [ 00:08:00.726 { 00:08:00.726 "transport": "RDMA", 00:08:00.726 "trtype": "RDMA", 00:08:00.726 "adrfam": "IPv4", 00:08:00.726 "traddr": "192.168.100.8", 00:08:00.726 "trsvcid": "4420" 00:08:00.726 } 00:08:00.726 ], 00:08:00.726 "allow_any_host": true, 00:08:00.726 "hosts": [], 00:08:00.726 "serial_number": "SPDK00000000000003", 00:08:00.726 "model_number": "SPDK bdev Controller", 00:08:00.726 "max_namespaces": 32, 00:08:00.726 "min_cntlid": 1, 00:08:00.726 "max_cntlid": 65519, 00:08:00.726 "namespaces": [ 00:08:00.726 { 00:08:00.726 "nsid": 1, 00:08:00.726 "bdev_name": "Null3", 00:08:00.726 "name": "Null3", 00:08:00.726 "nguid": "A8EBA43D2C2148CF88DF8EBCC77182FF", 00:08:00.726 "uuid": "a8eba43d-2c21-48cf-88df-8ebcc77182ff" 00:08:00.726 } 00:08:00.726 ] 00:08:00.726 }, 00:08:00.726 { 00:08:00.726 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:00.726 "subtype": "NVMe", 00:08:00.726 "listen_addresses": [ 00:08:00.726 { 00:08:00.726 "transport": "RDMA", 00:08:00.726 "trtype": "RDMA", 00:08:00.726 "adrfam": "IPv4", 00:08:00.726 "traddr": "192.168.100.8", 00:08:00.726 "trsvcid": "4420" 00:08:00.726 } 00:08:00.726 ], 00:08:00.726 "allow_any_host": true, 00:08:00.726 "hosts": [], 00:08:00.726 "serial_number": "SPDK00000000000004", 00:08:00.726 "model_number": "SPDK bdev Controller", 00:08:00.726 "max_namespaces": 32, 00:08:00.726 "min_cntlid": 1, 00:08:00.726 "max_cntlid": 65519, 00:08:00.726 "namespaces": [ 00:08:00.726 { 00:08:00.726 "nsid": 1, 00:08:00.726 "bdev_name": "Null4", 00:08:00.726 "name": "Null4", 00:08:00.726 "nguid": "8116D406714040FFA912797A725072A4", 00:08:00.726 "uuid": "8116d406-7140-40ff-a912-797a725072a4" 00:08:00.726 } 00:08:00.726 ] 00:08:00.726 } 00:08:00.726 ] 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@42 -- # seq 1 4 00:08:00.726 19:14:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:00.726 19:14:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:00.726 19:14:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:00.726 19:14:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:00.726 19:14:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.726 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.726 19:14:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:00.726 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.726 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.984 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.984 19:14:47 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:08:00.984 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.984 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.984 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.984 19:14:47 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:00.984 19:14:47 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:00.984 19:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:00.984 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:08:00.984 19:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:00.984 19:14:47 -- target/discovery.sh@49 -- # check_bdevs= 00:08:00.984 19:14:47 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:00.984 19:14:47 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:00.984 19:14:47 -- target/discovery.sh@57 -- # nvmftestfini 00:08:00.984 19:14:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:00.984 19:14:47 -- nvmf/common.sh@117 -- # sync 00:08:00.984 19:14:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:00.984 19:14:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:00.984 19:14:47 -- nvmf/common.sh@120 -- # set +e 00:08:00.984 19:14:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:00.984 19:14:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:00.984 rmmod nvme_rdma 00:08:00.984 rmmod nvme_fabrics 00:08:00.984 19:14:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:00.984 19:14:47 -- nvmf/common.sh@124 -- # set -e 00:08:00.984 19:14:47 -- nvmf/common.sh@125 -- # return 0 00:08:00.984 19:14:47 -- nvmf/common.sh@478 -- # '[' -n 2916669 ']' 00:08:00.984 19:14:47 -- nvmf/common.sh@479 -- # killprocess 2916669 00:08:00.984 19:14:47 -- common/autotest_common.sh@936 -- # '[' -z 2916669 ']' 00:08:00.984 19:14:47 -- common/autotest_common.sh@940 -- # kill -0 2916669 00:08:00.984 19:14:47 -- common/autotest_common.sh@941 -- # uname 00:08:00.984 19:14:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:00.984 19:14:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2916669 00:08:00.984 19:14:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:00.984 19:14:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:00.984 19:14:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2916669' 00:08:00.984 killing process with pid 2916669 00:08:00.984 19:14:47 -- common/autotest_common.sh@955 -- # kill 2916669 00:08:00.984 [2024-04-24 19:14:47.915001] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:00.984 19:14:47 -- common/autotest_common.sh@960 -- # wait 2916669 00:08:01.242 [2024-04-24 19:14:48.005319] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:01.242 19:14:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:01.242 19:14:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:01.242 00:08:01.242 real 0m8.686s 00:08:01.242 user 0m8.655s 00:08:01.242 sys 0m5.536s 00:08:01.242 19:14:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:01.242 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:08:01.242 ************************************ 00:08:01.242 END TEST nvmf_discovery 00:08:01.242 ************************************ 00:08:01.500 19:14:48 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:01.500 19:14:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:01.500 19:14:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.500 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:08:01.500 ************************************ 00:08:01.501 START TEST nvmf_referrals 00:08:01.501 ************************************ 00:08:01.501 19:14:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:01.501 * Looking for test storage... 00:08:01.501 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:01.501 19:14:48 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:01.501 19:14:48 -- nvmf/common.sh@7 -- # uname -s 00:08:01.501 19:14:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:01.501 19:14:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:01.501 19:14:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:01.501 19:14:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:01.501 19:14:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:01.501 19:14:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:01.501 19:14:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:01.501 19:14:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:01.501 19:14:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:01.501 19:14:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:01.760 19:14:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:01.760 19:14:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:08:01.760 19:14:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:01.760 19:14:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:01.760 19:14:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:01.760 19:14:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:01.760 19:14:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:01.760 19:14:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:01.760 19:14:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:01.760 19:14:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:01.760 19:14:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.760 19:14:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.760 19:14:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.760 19:14:48 -- paths/export.sh@5 -- # export PATH 00:08:01.760 19:14:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.760 19:14:48 -- nvmf/common.sh@47 -- # : 0 00:08:01.760 19:14:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:01.760 19:14:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:01.760 19:14:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:01.760 19:14:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:01.760 19:14:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:01.760 19:14:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:01.760 19:14:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:01.760 19:14:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:01.760 19:14:48 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:01.760 19:14:48 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:01.760 19:14:48 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:01.760 19:14:48 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:01.760 19:14:48 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:01.760 19:14:48 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:01.760 19:14:48 -- target/referrals.sh@37 -- # nvmftestinit 00:08:01.760 19:14:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:01.760 19:14:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:01.760 19:14:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:01.760 19:14:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:01.760 19:14:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:01.760 19:14:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:01.760 19:14:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:01.760 19:14:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:01.760 19:14:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:01.760 19:14:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:01.760 19:14:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:01.760 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:08:08.381 19:14:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:08.381 19:14:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:08.381 19:14:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:08.381 19:14:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:08.381 19:14:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:08.381 19:14:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:08.381 19:14:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:08.381 19:14:54 -- nvmf/common.sh@295 -- # net_devs=() 00:08:08.381 19:14:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:08.381 19:14:54 -- nvmf/common.sh@296 -- # e810=() 00:08:08.381 19:14:54 -- nvmf/common.sh@296 -- # local -ga e810 00:08:08.381 19:14:54 -- nvmf/common.sh@297 -- # x722=() 00:08:08.381 19:14:54 -- nvmf/common.sh@297 -- # local -ga x722 00:08:08.381 19:14:54 -- nvmf/common.sh@298 -- # mlx=() 00:08:08.381 19:14:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:08.381 19:14:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:08.381 19:14:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:08.381 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:08.381 19:14:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:08.381 19:14:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:08.381 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:08.381 19:14:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:08.381 19:14:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:08.381 19:14:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:08.381 19:14:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:08.381 Found net devices under 0000:18:00.0: mlx_0_0 00:08:08.381 19:14:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:08.381 19:14:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:08.381 19:14:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:08.381 Found net devices under 0000:18:00.1: mlx_0_1 00:08:08.381 19:14:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:08.381 19:14:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:08.381 19:14:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:08.381 19:14:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:08.381 19:14:54 -- nvmf/common.sh@58 -- # uname 00:08:08.381 19:14:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:08.381 19:14:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:08.381 19:14:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:08.381 19:14:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:08.381 19:14:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:08.381 19:14:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:08.381 19:14:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:08.381 19:14:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:08.381 19:14:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:08.381 19:14:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:08.381 19:14:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:08.381 19:14:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:08.381 19:14:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:08.381 19:14:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:08.381 19:14:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:08.381 19:14:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:08.381 19:14:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:08.381 19:14:54 -- nvmf/common.sh@105 -- # continue 2 00:08:08.381 19:14:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.381 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:08.381 19:14:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:08.381 19:14:54 -- nvmf/common.sh@105 -- # continue 2 00:08:08.381 19:14:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:08.381 19:14:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:08.381 19:14:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:08.381 19:14:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:08.381 19:14:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.381 19:14:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.382 19:14:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:08.382 19:14:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:08.382 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:08.382 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:08:08.382 altname enp24s0f0np0 00:08:08.382 altname ens785f0np0 00:08:08.382 inet 192.168.100.8/24 scope global mlx_0_0 00:08:08.382 valid_lft forever preferred_lft forever 00:08:08.382 19:14:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:08.382 19:14:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.382 19:14:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:08.382 19:14:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:08.382 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:08.382 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:08:08.382 altname enp24s0f1np1 00:08:08.382 altname ens785f1np1 00:08:08.382 inet 192.168.100.9/24 scope global mlx_0_1 00:08:08.382 valid_lft forever preferred_lft forever 00:08:08.382 19:14:54 -- nvmf/common.sh@411 -- # return 0 00:08:08.382 19:14:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:08.382 19:14:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:08.382 19:14:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:08.382 19:14:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:08.382 19:14:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:08.382 19:14:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:08.382 19:14:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:08.382 19:14:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:08.382 19:14:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:08.382 19:14:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.382 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.382 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:08.382 19:14:54 -- nvmf/common.sh@105 -- # continue 2 00:08:08.382 19:14:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.382 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.382 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.382 19:14:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:08.382 19:14:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@105 -- # continue 2 00:08:08.382 19:14:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:08.382 19:14:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:08.382 19:14:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.382 19:14:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:08.382 19:14:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.382 19:14:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.382 19:14:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:08.382 192.168.100.9' 00:08:08.382 19:14:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:08.382 192.168.100.9' 00:08:08.382 19:14:54 -- nvmf/common.sh@446 -- # head -n 1 00:08:08.382 19:14:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:08.382 19:14:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:08.382 192.168.100.9' 00:08:08.382 19:14:54 -- nvmf/common.sh@447 -- # tail -n +2 00:08:08.382 19:14:54 -- nvmf/common.sh@447 -- # head -n 1 00:08:08.382 19:14:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:08.382 19:14:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:08.382 19:14:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:08.382 19:14:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:08.382 19:14:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:08.382 19:14:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:08.382 19:14:54 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:08.382 19:14:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:08.382 19:14:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:08.382 19:14:54 -- common/autotest_common.sh@10 -- # set +x 00:08:08.382 19:14:54 -- nvmf/common.sh@470 -- # nvmfpid=2919794 00:08:08.382 19:14:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:08.382 19:14:54 -- nvmf/common.sh@471 -- # waitforlisten 2919794 00:08:08.382 19:14:54 -- common/autotest_common.sh@817 -- # '[' -z 2919794 ']' 00:08:08.382 19:14:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:08.382 19:14:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:08.382 19:14:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:08.382 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:08.382 19:14:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:08.382 19:14:54 -- common/autotest_common.sh@10 -- # set +x 00:08:08.382 [2024-04-24 19:14:54.641158] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:08:08.382 [2024-04-24 19:14:54.641215] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:08.382 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.382 [2024-04-24 19:14:54.710731] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:08.382 [2024-04-24 19:14:54.795933] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:08.382 [2024-04-24 19:14:54.795976] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:08.382 [2024-04-24 19:14:54.795985] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:08.382 [2024-04-24 19:14:54.796009] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:08.382 [2024-04-24 19:14:54.796016] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:08.382 [2024-04-24 19:14:54.796086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:08.382 [2024-04-24 19:14:54.796186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:08.382 [2024-04-24 19:14:54.796266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:08.382 [2024-04-24 19:14:54.796268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.640 19:14:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:08.640 19:14:55 -- common/autotest_common.sh@850 -- # return 0 00:08:08.640 19:14:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:08.640 19:14:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:08.640 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.640 19:14:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:08.640 19:14:55 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:08.640 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.640 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.640 [2024-04-24 19:14:55.538117] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d5e240/0x1d62730) succeed. 00:08:08.640 [2024-04-24 19:14:55.548766] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d5f880/0x1da3dc0) succeed. 00:08:08.897 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 [2024-04-24 19:14:55.681548] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:08.898 19:14:55 -- target/referrals.sh@48 -- # jq length 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:08.898 19:14:55 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:08.898 19:14:55 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:08.898 19:14:55 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:08.898 19:14:55 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- target/referrals.sh@21 -- # sort 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:08.898 19:14:55 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:08.898 19:14:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:08.898 19:14:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:08.898 19:14:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:08.898 19:14:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:08.898 19:14:55 -- target/referrals.sh@26 -- # sort 00:08:08.898 19:14:55 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:08.898 19:14:55 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:08.898 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.898 19:14:55 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:08:08.898 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.898 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:55 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:08:09.156 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.156 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:55 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:09.156 19:14:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.156 19:14:55 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:55 -- target/referrals.sh@56 -- # jq length 00:08:09.156 19:14:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:55 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:09.156 19:14:55 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:09.156 19:14:55 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:09.156 19:14:55 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:09.156 19:14:55 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.156 19:14:55 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:09.156 19:14:55 -- target/referrals.sh@26 -- # sort 00:08:09.156 19:14:56 -- target/referrals.sh@26 -- # echo 00:08:09.156 19:14:56 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:09.156 19:14:56 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:08:09.156 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.156 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:56 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:09.156 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.156 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:56 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:09.156 19:14:56 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:09.156 19:14:56 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:09.156 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.156 19:14:56 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:09.156 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.156 19:14:56 -- target/referrals.sh@21 -- # sort 00:08:09.156 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.156 19:14:56 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:09.156 19:14:56 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:09.156 19:14:56 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:09.156 19:14:56 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:09.156 19:14:56 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:09.156 19:14:56 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.156 19:14:56 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:09.156 19:14:56 -- target/referrals.sh@26 -- # sort 00:08:09.414 19:14:56 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:09.414 19:14:56 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:09.414 19:14:56 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:09.414 19:14:56 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:09.414 19:14:56 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:09.414 19:14:56 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.414 19:14:56 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:09.414 19:14:56 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:09.414 19:14:56 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:09.414 19:14:56 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:09.414 19:14:56 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:09.414 19:14:56 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.414 19:14:56 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:09.414 19:14:56 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:09.414 19:14:56 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:09.414 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.414 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.671 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.671 19:14:56 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:09.671 19:14:56 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:09.671 19:14:56 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:09.671 19:14:56 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:09.671 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.671 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.671 19:14:56 -- target/referrals.sh@21 -- # sort 00:08:09.671 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.671 19:14:56 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:09.671 19:14:56 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:09.671 19:14:56 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:09.671 19:14:56 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:09.671 19:14:56 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:09.671 19:14:56 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:09.671 19:14:56 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.671 19:14:56 -- target/referrals.sh@26 -- # sort 00:08:09.671 19:14:56 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:09.671 19:14:56 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:09.671 19:14:56 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:09.671 19:14:56 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:09.671 19:14:56 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:09.671 19:14:56 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.671 19:14:56 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:09.671 19:14:56 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:09.671 19:14:56 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:09.671 19:14:56 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:09.671 19:14:56 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:09.671 19:14:56 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.671 19:14:56 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:09.929 19:14:56 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:09.929 19:14:56 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:09.929 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.929 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.929 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.929 19:14:56 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:09.929 19:14:56 -- target/referrals.sh@82 -- # jq length 00:08:09.929 19:14:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:09.929 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:08:09.929 19:14:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:09.929 19:14:56 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:09.929 19:14:56 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:09.929 19:14:56 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:09.929 19:14:56 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:09.929 19:14:56 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:09.929 19:14:56 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:09.929 19:14:56 -- target/referrals.sh@26 -- # sort 00:08:09.929 19:14:56 -- target/referrals.sh@26 -- # echo 00:08:09.929 19:14:56 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:09.929 19:14:56 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:09.929 19:14:56 -- target/referrals.sh@86 -- # nvmftestfini 00:08:09.929 19:14:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:09.929 19:14:56 -- nvmf/common.sh@117 -- # sync 00:08:09.929 19:14:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:09.929 19:14:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:09.929 19:14:56 -- nvmf/common.sh@120 -- # set +e 00:08:09.929 19:14:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:09.929 19:14:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:09.929 rmmod nvme_rdma 00:08:10.187 rmmod nvme_fabrics 00:08:10.187 19:14:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:10.187 19:14:56 -- nvmf/common.sh@124 -- # set -e 00:08:10.187 19:14:56 -- nvmf/common.sh@125 -- # return 0 00:08:10.187 19:14:56 -- nvmf/common.sh@478 -- # '[' -n 2919794 ']' 00:08:10.187 19:14:56 -- nvmf/common.sh@479 -- # killprocess 2919794 00:08:10.187 19:14:56 -- common/autotest_common.sh@936 -- # '[' -z 2919794 ']' 00:08:10.187 19:14:56 -- common/autotest_common.sh@940 -- # kill -0 2919794 00:08:10.187 19:14:56 -- common/autotest_common.sh@941 -- # uname 00:08:10.187 19:14:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:10.187 19:14:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2919794 00:08:10.187 19:14:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:10.187 19:14:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:10.187 19:14:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2919794' 00:08:10.187 killing process with pid 2919794 00:08:10.187 19:14:57 -- common/autotest_common.sh@955 -- # kill 2919794 00:08:10.187 19:14:57 -- common/autotest_common.sh@960 -- # wait 2919794 00:08:10.187 [2024-04-24 19:14:57.131257] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:10.445 19:14:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:10.445 19:14:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:10.445 00:08:10.445 real 0m8.957s 00:08:10.445 user 0m12.556s 00:08:10.445 sys 0m5.448s 00:08:10.445 19:14:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.445 19:14:57 -- common/autotest_common.sh@10 -- # set +x 00:08:10.445 ************************************ 00:08:10.445 END TEST nvmf_referrals 00:08:10.445 ************************************ 00:08:10.445 19:14:57 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:10.445 19:14:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:10.445 19:14:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.445 19:14:57 -- common/autotest_common.sh@10 -- # set +x 00:08:10.703 ************************************ 00:08:10.703 START TEST nvmf_connect_disconnect 00:08:10.703 ************************************ 00:08:10.703 19:14:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:10.703 * Looking for test storage... 00:08:10.703 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:10.703 19:14:57 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:10.703 19:14:57 -- nvmf/common.sh@7 -- # uname -s 00:08:10.703 19:14:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:10.703 19:14:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:10.703 19:14:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:10.703 19:14:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:10.703 19:14:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:10.703 19:14:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:10.703 19:14:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:10.703 19:14:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:10.703 19:14:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:10.703 19:14:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:10.703 19:14:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:10.703 19:14:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:08:10.703 19:14:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:10.703 19:14:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:10.703 19:14:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:10.703 19:14:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:10.703 19:14:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:10.703 19:14:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:10.703 19:14:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:10.703 19:14:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:10.703 19:14:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:10.703 19:14:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:10.703 19:14:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:10.703 19:14:57 -- paths/export.sh@5 -- # export PATH 00:08:10.703 19:14:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:10.703 19:14:57 -- nvmf/common.sh@47 -- # : 0 00:08:10.703 19:14:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:10.703 19:14:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:10.703 19:14:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:10.703 19:14:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:10.703 19:14:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:10.703 19:14:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:10.703 19:14:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:10.703 19:14:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:10.703 19:14:57 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:10.703 19:14:57 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:10.703 19:14:57 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:10.703 19:14:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:10.703 19:14:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:10.703 19:14:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:10.704 19:14:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:10.704 19:14:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:10.704 19:14:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:10.704 19:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:10.704 19:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:10.704 19:14:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:10.704 19:14:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:10.704 19:14:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:10.704 19:14:57 -- common/autotest_common.sh@10 -- # set +x 00:08:17.258 19:15:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:17.258 19:15:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:17.258 19:15:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:17.258 19:15:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:17.258 19:15:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:17.258 19:15:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:17.258 19:15:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:17.258 19:15:03 -- nvmf/common.sh@295 -- # net_devs=() 00:08:17.258 19:15:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:17.258 19:15:03 -- nvmf/common.sh@296 -- # e810=() 00:08:17.258 19:15:03 -- nvmf/common.sh@296 -- # local -ga e810 00:08:17.258 19:15:03 -- nvmf/common.sh@297 -- # x722=() 00:08:17.258 19:15:03 -- nvmf/common.sh@297 -- # local -ga x722 00:08:17.258 19:15:03 -- nvmf/common.sh@298 -- # mlx=() 00:08:17.258 19:15:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:17.258 19:15:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:17.258 19:15:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:17.258 19:15:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:17.258 19:15:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:17.258 19:15:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:17.258 19:15:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:17.258 19:15:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:17.258 19:15:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:17.258 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:17.258 19:15:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:17.258 19:15:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:17.258 19:15:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:17.258 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:17.258 19:15:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:17.258 19:15:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:17.258 19:15:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:17.258 19:15:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:17.258 19:15:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:17.258 19:15:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:17.258 19:15:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:17.258 19:15:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:17.258 Found net devices under 0000:18:00.0: mlx_0_0 00:08:17.258 19:15:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:17.258 19:15:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:17.258 19:15:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:17.258 19:15:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:17.258 19:15:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:17.258 19:15:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:17.258 Found net devices under 0000:18:00.1: mlx_0_1 00:08:17.258 19:15:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:17.259 19:15:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:17.259 19:15:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:17.259 19:15:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:17.259 19:15:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:17.259 19:15:03 -- nvmf/common.sh@58 -- # uname 00:08:17.259 19:15:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:17.259 19:15:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:17.259 19:15:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:17.259 19:15:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:17.259 19:15:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:17.259 19:15:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:17.259 19:15:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:17.259 19:15:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:17.259 19:15:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:17.259 19:15:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:17.259 19:15:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:17.259 19:15:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:17.259 19:15:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:17.259 19:15:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:17.259 19:15:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:17.259 19:15:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:17.259 19:15:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@105 -- # continue 2 00:08:17.259 19:15:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@105 -- # continue 2 00:08:17.259 19:15:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:17.259 19:15:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:17.259 19:15:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:17.259 19:15:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:17.259 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:17.259 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:08:17.259 altname enp24s0f0np0 00:08:17.259 altname ens785f0np0 00:08:17.259 inet 192.168.100.8/24 scope global mlx_0_0 00:08:17.259 valid_lft forever preferred_lft forever 00:08:17.259 19:15:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:17.259 19:15:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:17.259 19:15:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:17.259 19:15:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:17.259 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:17.259 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:08:17.259 altname enp24s0f1np1 00:08:17.259 altname ens785f1np1 00:08:17.259 inet 192.168.100.9/24 scope global mlx_0_1 00:08:17.259 valid_lft forever preferred_lft forever 00:08:17.259 19:15:03 -- nvmf/common.sh@411 -- # return 0 00:08:17.259 19:15:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:17.259 19:15:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:17.259 19:15:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:17.259 19:15:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:17.259 19:15:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:17.259 19:15:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:17.259 19:15:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:17.259 19:15:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:17.259 19:15:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:17.259 19:15:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@105 -- # continue 2 00:08:17.259 19:15:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:17.259 19:15:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:17.259 19:15:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@105 -- # continue 2 00:08:17.259 19:15:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:17.259 19:15:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:17.259 19:15:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:17.259 19:15:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:17.259 19:15:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:17.259 19:15:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:17.259 192.168.100.9' 00:08:17.259 19:15:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:17.259 192.168.100.9' 00:08:17.259 19:15:03 -- nvmf/common.sh@446 -- # head -n 1 00:08:17.259 19:15:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:17.259 19:15:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:17.259 192.168.100.9' 00:08:17.259 19:15:03 -- nvmf/common.sh@447 -- # tail -n +2 00:08:17.259 19:15:03 -- nvmf/common.sh@447 -- # head -n 1 00:08:17.259 19:15:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:17.259 19:15:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:17.259 19:15:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:17.259 19:15:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:17.259 19:15:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:17.259 19:15:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:17.259 19:15:03 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:17.259 19:15:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:17.259 19:15:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:17.259 19:15:03 -- common/autotest_common.sh@10 -- # set +x 00:08:17.259 19:15:03 -- nvmf/common.sh@470 -- # nvmfpid=2923243 00:08:17.259 19:15:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:17.259 19:15:03 -- nvmf/common.sh@471 -- # waitforlisten 2923243 00:08:17.259 19:15:03 -- common/autotest_common.sh@817 -- # '[' -z 2923243 ']' 00:08:17.259 19:15:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:17.259 19:15:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:17.259 19:15:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:17.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:17.259 19:15:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:17.259 19:15:03 -- common/autotest_common.sh@10 -- # set +x 00:08:17.259 [2024-04-24 19:15:03.639047] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:08:17.259 [2024-04-24 19:15:03.639115] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:17.259 EAL: No free 2048 kB hugepages reported on node 1 00:08:17.259 [2024-04-24 19:15:03.712141] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:17.259 [2024-04-24 19:15:03.799386] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:17.259 [2024-04-24 19:15:03.799426] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:17.259 [2024-04-24 19:15:03.799435] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:17.259 [2024-04-24 19:15:03.799446] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:17.259 [2024-04-24 19:15:03.799453] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:17.259 [2024-04-24 19:15:03.799513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:17.259 [2024-04-24 19:15:03.799593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:17.259 [2024-04-24 19:15:03.799623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:17.259 [2024-04-24 19:15:03.799625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:17.517 19:15:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:17.517 19:15:04 -- common/autotest_common.sh@850 -- # return 0 00:08:17.517 19:15:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:17.517 19:15:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:17.517 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.517 19:15:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:17.517 19:15:04 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:17.517 19:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.517 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.517 [2024-04-24 19:15:04.522640] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:17.775 [2024-04-24 19:15:04.544343] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1760240/0x1764730) succeed. 00:08:17.775 [2024-04-24 19:15:04.554680] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1761880/0x17a5dc0) succeed. 00:08:17.775 19:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:17.775 19:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.775 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.775 19:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:17.775 19:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.775 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.775 19:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:17.775 19:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.775 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.775 19:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:17.775 19:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.775 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:08:17.775 [2024-04-24 19:15:04.702938] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:17.775 19:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:08:17.775 19:15:04 -- target/connect_disconnect.sh@34 -- # set +x 00:08:21.956 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.783 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.784 19:15:24 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:08:37.784 19:15:24 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:08:37.784 19:15:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:37.784 19:15:24 -- nvmf/common.sh@117 -- # sync 00:08:37.784 19:15:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:37.784 19:15:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:37.784 19:15:24 -- nvmf/common.sh@120 -- # set +e 00:08:37.784 19:15:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:37.784 19:15:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:37.784 rmmod nvme_rdma 00:08:37.784 rmmod nvme_fabrics 00:08:37.784 19:15:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:37.784 19:15:24 -- nvmf/common.sh@124 -- # set -e 00:08:37.784 19:15:24 -- nvmf/common.sh@125 -- # return 0 00:08:37.784 19:15:24 -- nvmf/common.sh@478 -- # '[' -n 2923243 ']' 00:08:37.784 19:15:24 -- nvmf/common.sh@479 -- # killprocess 2923243 00:08:37.784 19:15:24 -- common/autotest_common.sh@936 -- # '[' -z 2923243 ']' 00:08:37.784 19:15:24 -- common/autotest_common.sh@940 -- # kill -0 2923243 00:08:37.784 19:15:24 -- common/autotest_common.sh@941 -- # uname 00:08:37.784 19:15:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:37.784 19:15:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2923243 00:08:37.784 19:15:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:37.784 19:15:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:37.784 19:15:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2923243' 00:08:37.784 killing process with pid 2923243 00:08:37.784 19:15:24 -- common/autotest_common.sh@955 -- # kill 2923243 00:08:37.784 19:15:24 -- common/autotest_common.sh@960 -- # wait 2923243 00:08:37.784 [2024-04-24 19:15:24.785322] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:38.042 19:15:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:38.042 19:15:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:38.042 00:08:38.042 real 0m27.500s 00:08:38.042 user 1m25.886s 00:08:38.042 sys 0m5.705s 00:08:38.042 19:15:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:38.042 19:15:25 -- common/autotest_common.sh@10 -- # set +x 00:08:38.042 ************************************ 00:08:38.042 END TEST nvmf_connect_disconnect 00:08:38.042 ************************************ 00:08:38.042 19:15:25 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:38.042 19:15:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:38.042 19:15:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.042 19:15:25 -- common/autotest_common.sh@10 -- # set +x 00:08:38.301 ************************************ 00:08:38.301 START TEST nvmf_multitarget 00:08:38.301 ************************************ 00:08:38.301 19:15:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:38.561 * Looking for test storage... 00:08:38.561 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:38.561 19:15:25 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:38.561 19:15:25 -- nvmf/common.sh@7 -- # uname -s 00:08:38.561 19:15:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:38.561 19:15:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:38.561 19:15:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:38.561 19:15:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:38.561 19:15:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:38.561 19:15:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:38.561 19:15:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:38.561 19:15:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:38.561 19:15:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:38.561 19:15:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:38.561 19:15:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:38.561 19:15:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:08:38.561 19:15:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:38.561 19:15:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:38.561 19:15:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:38.561 19:15:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:38.561 19:15:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:38.561 19:15:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:38.561 19:15:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:38.561 19:15:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:38.561 19:15:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:38.561 19:15:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:38.561 19:15:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:38.561 19:15:25 -- paths/export.sh@5 -- # export PATH 00:08:38.561 19:15:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:38.561 19:15:25 -- nvmf/common.sh@47 -- # : 0 00:08:38.561 19:15:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:38.561 19:15:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:38.561 19:15:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:38.561 19:15:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:38.561 19:15:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:38.561 19:15:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:38.561 19:15:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:38.561 19:15:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:38.561 19:15:25 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:08:38.561 19:15:25 -- target/multitarget.sh@15 -- # nvmftestinit 00:08:38.561 19:15:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:38.561 19:15:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:38.561 19:15:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:38.561 19:15:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:38.561 19:15:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:38.561 19:15:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:38.561 19:15:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:38.561 19:15:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:38.561 19:15:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:38.561 19:15:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:38.561 19:15:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:38.561 19:15:25 -- common/autotest_common.sh@10 -- # set +x 00:08:45.125 19:15:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:45.125 19:15:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:45.125 19:15:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:45.125 19:15:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:45.125 19:15:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:45.125 19:15:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:45.125 19:15:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:45.125 19:15:31 -- nvmf/common.sh@295 -- # net_devs=() 00:08:45.125 19:15:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:45.125 19:15:31 -- nvmf/common.sh@296 -- # e810=() 00:08:45.125 19:15:31 -- nvmf/common.sh@296 -- # local -ga e810 00:08:45.125 19:15:31 -- nvmf/common.sh@297 -- # x722=() 00:08:45.125 19:15:31 -- nvmf/common.sh@297 -- # local -ga x722 00:08:45.125 19:15:31 -- nvmf/common.sh@298 -- # mlx=() 00:08:45.125 19:15:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:45.125 19:15:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:45.125 19:15:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:45.125 19:15:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:45.125 19:15:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:45.125 19:15:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:45.125 19:15:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:45.125 19:15:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:45.125 19:15:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:45.125 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:45.125 19:15:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:45.125 19:15:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:45.125 19:15:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:45.125 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:45.125 19:15:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:45.125 19:15:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:45.125 19:15:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:45.125 19:15:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:45.125 19:15:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.125 19:15:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:45.125 19:15:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.125 19:15:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:45.125 Found net devices under 0000:18:00.0: mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.126 19:15:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.126 19:15:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:45.126 19:15:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.126 19:15:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:45.126 Found net devices under 0000:18:00.1: mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.126 19:15:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:45.126 19:15:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:45.126 19:15:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:45.126 19:15:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:45.126 19:15:31 -- nvmf/common.sh@58 -- # uname 00:08:45.126 19:15:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:45.126 19:15:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:45.126 19:15:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:45.126 19:15:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:45.126 19:15:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:45.126 19:15:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:45.126 19:15:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:45.126 19:15:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:45.126 19:15:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:45.126 19:15:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:45.126 19:15:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:45.126 19:15:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:45.126 19:15:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:45.126 19:15:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:45.126 19:15:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:45.126 19:15:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:45.126 19:15:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@105 -- # continue 2 00:08:45.126 19:15:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@105 -- # continue 2 00:08:45.126 19:15:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:45.126 19:15:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:45.126 19:15:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:45.126 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:45.126 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:08:45.126 altname enp24s0f0np0 00:08:45.126 altname ens785f0np0 00:08:45.126 inet 192.168.100.8/24 scope global mlx_0_0 00:08:45.126 valid_lft forever preferred_lft forever 00:08:45.126 19:15:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:45.126 19:15:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:45.126 19:15:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:45.126 19:15:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:45.126 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:45.126 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:08:45.126 altname enp24s0f1np1 00:08:45.126 altname ens785f1np1 00:08:45.126 inet 192.168.100.9/24 scope global mlx_0_1 00:08:45.126 valid_lft forever preferred_lft forever 00:08:45.126 19:15:31 -- nvmf/common.sh@411 -- # return 0 00:08:45.126 19:15:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:45.126 19:15:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:45.126 19:15:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:45.126 19:15:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:45.126 19:15:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:45.126 19:15:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:45.126 19:15:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:45.126 19:15:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:45.126 19:15:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:45.126 19:15:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@105 -- # continue 2 00:08:45.126 19:15:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:45.126 19:15:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:45.126 19:15:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@105 -- # continue 2 00:08:45.126 19:15:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:45.126 19:15:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:45.126 19:15:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:45.126 19:15:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:45.126 19:15:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:45.126 19:15:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:45.126 192.168.100.9' 00:08:45.126 19:15:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:45.126 192.168.100.9' 00:08:45.126 19:15:31 -- nvmf/common.sh@446 -- # head -n 1 00:08:45.126 19:15:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:45.126 19:15:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:45.126 192.168.100.9' 00:08:45.126 19:15:31 -- nvmf/common.sh@447 -- # tail -n +2 00:08:45.126 19:15:31 -- nvmf/common.sh@447 -- # head -n 1 00:08:45.126 19:15:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:45.126 19:15:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:45.126 19:15:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:45.126 19:15:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:45.126 19:15:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:45.126 19:15:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:45.126 19:15:31 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:08:45.126 19:15:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:45.126 19:15:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:45.126 19:15:31 -- common/autotest_common.sh@10 -- # set +x 00:08:45.126 19:15:31 -- nvmf/common.sh@470 -- # nvmfpid=2929405 00:08:45.126 19:15:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:45.126 19:15:31 -- nvmf/common.sh@471 -- # waitforlisten 2929405 00:08:45.126 19:15:31 -- common/autotest_common.sh@817 -- # '[' -z 2929405 ']' 00:08:45.126 19:15:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:45.126 19:15:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:45.126 19:15:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:45.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:45.126 19:15:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:45.126 19:15:31 -- common/autotest_common.sh@10 -- # set +x 00:08:45.127 [2024-04-24 19:15:31.512990] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:08:45.127 [2024-04-24 19:15:31.513047] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:45.127 EAL: No free 2048 kB hugepages reported on node 1 00:08:45.127 [2024-04-24 19:15:31.586635] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:45.127 [2024-04-24 19:15:31.672634] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:45.127 [2024-04-24 19:15:31.672676] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:45.127 [2024-04-24 19:15:31.672685] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:45.127 [2024-04-24 19:15:31.672694] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:45.127 [2024-04-24 19:15:31.672702] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:45.127 [2024-04-24 19:15:31.672755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:45.127 [2024-04-24 19:15:31.672843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:45.127 [2024-04-24 19:15:31.672920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:45.127 [2024-04-24 19:15:31.672922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.385 19:15:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:45.385 19:15:32 -- common/autotest_common.sh@850 -- # return 0 00:08:45.385 19:15:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:45.385 19:15:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:45.385 19:15:32 -- common/autotest_common.sh@10 -- # set +x 00:08:45.385 19:15:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:45.385 19:15:32 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:08:45.385 19:15:32 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:45.385 19:15:32 -- target/multitarget.sh@21 -- # jq length 00:08:45.643 19:15:32 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:08:45.643 19:15:32 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:08:45.643 "nvmf_tgt_1" 00:08:45.643 19:15:32 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:08:45.902 "nvmf_tgt_2" 00:08:45.902 19:15:32 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:45.902 19:15:32 -- target/multitarget.sh@28 -- # jq length 00:08:45.902 19:15:32 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:08:45.902 19:15:32 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:08:45.902 true 00:08:45.902 19:15:32 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:08:46.160 true 00:08:46.160 19:15:33 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:46.160 19:15:33 -- target/multitarget.sh@35 -- # jq length 00:08:46.160 19:15:33 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:08:46.160 19:15:33 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:08:46.160 19:15:33 -- target/multitarget.sh@41 -- # nvmftestfini 00:08:46.160 19:15:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:46.160 19:15:33 -- nvmf/common.sh@117 -- # sync 00:08:46.160 19:15:33 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:46.160 19:15:33 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:46.160 19:15:33 -- nvmf/common.sh@120 -- # set +e 00:08:46.160 19:15:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:46.160 19:15:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:46.160 rmmod nvme_rdma 00:08:46.160 rmmod nvme_fabrics 00:08:46.160 19:15:33 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:46.160 19:15:33 -- nvmf/common.sh@124 -- # set -e 00:08:46.160 19:15:33 -- nvmf/common.sh@125 -- # return 0 00:08:46.160 19:15:33 -- nvmf/common.sh@478 -- # '[' -n 2929405 ']' 00:08:46.160 19:15:33 -- nvmf/common.sh@479 -- # killprocess 2929405 00:08:46.160 19:15:33 -- common/autotest_common.sh@936 -- # '[' -z 2929405 ']' 00:08:46.160 19:15:33 -- common/autotest_common.sh@940 -- # kill -0 2929405 00:08:46.160 19:15:33 -- common/autotest_common.sh@941 -- # uname 00:08:46.160 19:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:46.160 19:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2929405 00:08:46.419 19:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:46.419 19:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:46.419 19:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2929405' 00:08:46.419 killing process with pid 2929405 00:08:46.419 19:15:33 -- common/autotest_common.sh@955 -- # kill 2929405 00:08:46.419 19:15:33 -- common/autotest_common.sh@960 -- # wait 2929405 00:08:46.678 19:15:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:46.678 19:15:33 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:46.678 00:08:46.678 real 0m8.213s 00:08:46.678 user 0m9.382s 00:08:46.678 sys 0m5.268s 00:08:46.678 19:15:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:46.678 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:08:46.678 ************************************ 00:08:46.678 END TEST nvmf_multitarget 00:08:46.678 ************************************ 00:08:46.678 19:15:33 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:46.678 19:15:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:46.678 19:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:46.678 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:08:46.678 ************************************ 00:08:46.678 START TEST nvmf_rpc 00:08:46.678 ************************************ 00:08:46.678 19:15:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:46.937 * Looking for test storage... 00:08:46.937 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:46.937 19:15:33 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:46.937 19:15:33 -- nvmf/common.sh@7 -- # uname -s 00:08:46.937 19:15:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:46.937 19:15:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:46.937 19:15:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:46.937 19:15:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:46.937 19:15:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:46.937 19:15:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:46.937 19:15:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:46.937 19:15:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:46.937 19:15:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:46.937 19:15:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:46.937 19:15:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:46.937 19:15:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:08:46.937 19:15:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:46.937 19:15:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:46.937 19:15:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:46.937 19:15:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:46.937 19:15:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:46.937 19:15:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:46.938 19:15:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:46.938 19:15:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:46.938 19:15:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.938 19:15:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.938 19:15:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.938 19:15:33 -- paths/export.sh@5 -- # export PATH 00:08:46.938 19:15:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.938 19:15:33 -- nvmf/common.sh@47 -- # : 0 00:08:46.938 19:15:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:46.938 19:15:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:46.938 19:15:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:46.938 19:15:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:46.938 19:15:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:46.938 19:15:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:46.938 19:15:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:46.938 19:15:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:46.938 19:15:33 -- target/rpc.sh@11 -- # loops=5 00:08:46.938 19:15:33 -- target/rpc.sh@23 -- # nvmftestinit 00:08:46.938 19:15:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:46.938 19:15:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:46.938 19:15:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:46.938 19:15:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:46.938 19:15:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:46.938 19:15:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:46.938 19:15:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:46.938 19:15:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:46.938 19:15:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:46.938 19:15:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:46.938 19:15:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:46.938 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:08:53.582 19:15:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:53.582 19:15:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:53.582 19:15:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:53.582 19:15:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:53.582 19:15:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:53.582 19:15:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:53.582 19:15:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:53.582 19:15:39 -- nvmf/common.sh@295 -- # net_devs=() 00:08:53.582 19:15:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:53.582 19:15:39 -- nvmf/common.sh@296 -- # e810=() 00:08:53.582 19:15:39 -- nvmf/common.sh@296 -- # local -ga e810 00:08:53.582 19:15:39 -- nvmf/common.sh@297 -- # x722=() 00:08:53.582 19:15:39 -- nvmf/common.sh@297 -- # local -ga x722 00:08:53.582 19:15:39 -- nvmf/common.sh@298 -- # mlx=() 00:08:53.582 19:15:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:53.582 19:15:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:53.582 19:15:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:53.582 19:15:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:53.582 19:15:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:53.582 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:53.582 19:15:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:53.582 19:15:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:53.582 19:15:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:53.582 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:53.582 19:15:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:53.582 19:15:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:53.582 19:15:39 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:53.582 19:15:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.582 19:15:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:53.582 19:15:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.582 19:15:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:53.582 Found net devices under 0000:18:00.0: mlx_0_0 00:08:53.582 19:15:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:53.582 19:15:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.582 19:15:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:53.582 19:15:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.582 19:15:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:53.582 Found net devices under 0000:18:00.1: mlx_0_1 00:08:53.582 19:15:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.582 19:15:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:53.582 19:15:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:53.582 19:15:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:53.582 19:15:39 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:53.583 19:15:39 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:53.583 19:15:39 -- nvmf/common.sh@58 -- # uname 00:08:53.583 19:15:39 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:53.583 19:15:39 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:53.583 19:15:39 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:53.583 19:15:39 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:53.583 19:15:39 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:53.583 19:15:39 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:53.583 19:15:39 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:53.583 19:15:39 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:53.583 19:15:39 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:53.583 19:15:39 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:53.583 19:15:39 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:53.583 19:15:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:53.583 19:15:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:53.583 19:15:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:53.583 19:15:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:53.583 19:15:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:53.583 19:15:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@105 -- # continue 2 00:08:53.583 19:15:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@105 -- # continue 2 00:08:53.583 19:15:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:53.583 19:15:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:53.583 19:15:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:53.583 19:15:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:53.583 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:53.583 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:08:53.583 altname enp24s0f0np0 00:08:53.583 altname ens785f0np0 00:08:53.583 inet 192.168.100.8/24 scope global mlx_0_0 00:08:53.583 valid_lft forever preferred_lft forever 00:08:53.583 19:15:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:53.583 19:15:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:53.583 19:15:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:53.583 19:15:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:53.583 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:53.583 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:08:53.583 altname enp24s0f1np1 00:08:53.583 altname ens785f1np1 00:08:53.583 inet 192.168.100.9/24 scope global mlx_0_1 00:08:53.583 valid_lft forever preferred_lft forever 00:08:53.583 19:15:39 -- nvmf/common.sh@411 -- # return 0 00:08:53.583 19:15:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:53.583 19:15:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:53.583 19:15:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:53.583 19:15:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:53.583 19:15:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:53.583 19:15:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:53.583 19:15:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:53.583 19:15:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:53.583 19:15:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:53.583 19:15:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@105 -- # continue 2 00:08:53.583 19:15:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:53.583 19:15:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:53.583 19:15:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@105 -- # continue 2 00:08:53.583 19:15:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:53.583 19:15:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:53.583 19:15:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:53.583 19:15:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:53.583 19:15:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:53.583 19:15:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:53.583 192.168.100.9' 00:08:53.583 19:15:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:53.583 192.168.100.9' 00:08:53.583 19:15:39 -- nvmf/common.sh@446 -- # head -n 1 00:08:53.583 19:15:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:53.583 19:15:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:53.583 192.168.100.9' 00:08:53.583 19:15:39 -- nvmf/common.sh@447 -- # tail -n +2 00:08:53.583 19:15:39 -- nvmf/common.sh@447 -- # head -n 1 00:08:53.583 19:15:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:53.583 19:15:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:53.583 19:15:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:53.583 19:15:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:53.583 19:15:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:53.583 19:15:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:53.583 19:15:39 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:08:53.583 19:15:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:53.583 19:15:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:53.583 19:15:39 -- common/autotest_common.sh@10 -- # set +x 00:08:53.583 19:15:39 -- nvmf/common.sh@470 -- # nvmfpid=2932529 00:08:53.583 19:15:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:53.583 19:15:39 -- nvmf/common.sh@471 -- # waitforlisten 2932529 00:08:53.583 19:15:39 -- common/autotest_common.sh@817 -- # '[' -z 2932529 ']' 00:08:53.583 19:15:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:53.583 19:15:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:53.583 19:15:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:53.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:53.583 19:15:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:53.583 19:15:39 -- common/autotest_common.sh@10 -- # set +x 00:08:53.583 [2024-04-24 19:15:39.877228] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:08:53.583 [2024-04-24 19:15:39.877290] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:53.583 EAL: No free 2048 kB hugepages reported on node 1 00:08:53.583 [2024-04-24 19:15:39.948612] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:53.583 [2024-04-24 19:15:40.040066] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:53.583 [2024-04-24 19:15:40.040107] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:53.583 [2024-04-24 19:15:40.040118] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:53.583 [2024-04-24 19:15:40.040127] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:53.583 [2024-04-24 19:15:40.040135] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:53.583 [2024-04-24 19:15:40.040186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:53.583 [2024-04-24 19:15:40.040271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:53.583 [2024-04-24 19:15:40.040347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:53.583 [2024-04-24 19:15:40.040349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.842 19:15:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:53.842 19:15:40 -- common/autotest_common.sh@850 -- # return 0 00:08:53.842 19:15:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:53.842 19:15:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:53.842 19:15:40 -- common/autotest_common.sh@10 -- # set +x 00:08:53.842 19:15:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.842 19:15:40 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:08:53.842 19:15:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.842 19:15:40 -- common/autotest_common.sh@10 -- # set +x 00:08:53.842 19:15:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.842 19:15:40 -- target/rpc.sh@26 -- # stats='{ 00:08:53.842 "tick_rate": 2300000000, 00:08:53.842 "poll_groups": [ 00:08:53.842 { 00:08:53.842 "name": "nvmf_tgt_poll_group_0", 00:08:53.842 "admin_qpairs": 0, 00:08:53.842 "io_qpairs": 0, 00:08:53.842 "current_admin_qpairs": 0, 00:08:53.842 "current_io_qpairs": 0, 00:08:53.842 "pending_bdev_io": 0, 00:08:53.842 "completed_nvme_io": 0, 00:08:53.842 "transports": [] 00:08:53.842 }, 00:08:53.842 { 00:08:53.842 "name": "nvmf_tgt_poll_group_1", 00:08:53.842 "admin_qpairs": 0, 00:08:53.842 "io_qpairs": 0, 00:08:53.842 "current_admin_qpairs": 0, 00:08:53.842 "current_io_qpairs": 0, 00:08:53.842 "pending_bdev_io": 0, 00:08:53.842 "completed_nvme_io": 0, 00:08:53.842 "transports": [] 00:08:53.842 }, 00:08:53.842 { 00:08:53.842 "name": "nvmf_tgt_poll_group_2", 00:08:53.842 "admin_qpairs": 0, 00:08:53.842 "io_qpairs": 0, 00:08:53.842 "current_admin_qpairs": 0, 00:08:53.842 "current_io_qpairs": 0, 00:08:53.842 "pending_bdev_io": 0, 00:08:53.842 "completed_nvme_io": 0, 00:08:53.842 "transports": [] 00:08:53.842 }, 00:08:53.842 { 00:08:53.842 "name": "nvmf_tgt_poll_group_3", 00:08:53.842 "admin_qpairs": 0, 00:08:53.842 "io_qpairs": 0, 00:08:53.842 "current_admin_qpairs": 0, 00:08:53.842 "current_io_qpairs": 0, 00:08:53.842 "pending_bdev_io": 0, 00:08:53.842 "completed_nvme_io": 0, 00:08:53.842 "transports": [] 00:08:53.842 } 00:08:53.842 ] 00:08:53.842 }' 00:08:53.842 19:15:40 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:08:53.842 19:15:40 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:08:53.842 19:15:40 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:08:53.842 19:15:40 -- target/rpc.sh@15 -- # wc -l 00:08:53.842 19:15:40 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:08:53.842 19:15:40 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:08:53.842 19:15:40 -- target/rpc.sh@29 -- # [[ null == null ]] 00:08:53.842 19:15:40 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:53.842 19:15:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.842 19:15:40 -- common/autotest_common.sh@10 -- # set +x 00:08:54.101 [2024-04-24 19:15:40.879369] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19872a0/0x198b790) succeed. 00:08:54.101 [2024-04-24 19:15:40.889801] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x19888e0/0x19cce20) succeed. 00:08:54.101 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.101 19:15:41 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:08:54.101 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.101 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.101 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.101 19:15:41 -- target/rpc.sh@33 -- # stats='{ 00:08:54.101 "tick_rate": 2300000000, 00:08:54.101 "poll_groups": [ 00:08:54.101 { 00:08:54.101 "name": "nvmf_tgt_poll_group_0", 00:08:54.101 "admin_qpairs": 0, 00:08:54.101 "io_qpairs": 0, 00:08:54.101 "current_admin_qpairs": 0, 00:08:54.101 "current_io_qpairs": 0, 00:08:54.101 "pending_bdev_io": 0, 00:08:54.101 "completed_nvme_io": 0, 00:08:54.101 "transports": [ 00:08:54.101 { 00:08:54.101 "trtype": "RDMA", 00:08:54.101 "pending_data_buffer": 0, 00:08:54.101 "devices": [ 00:08:54.101 { 00:08:54.101 "name": "mlx5_0", 00:08:54.101 "polls": 15291, 00:08:54.101 "idle_polls": 15291, 00:08:54.101 "completions": 0, 00:08:54.101 "requests": 0, 00:08:54.101 "request_latency": 0, 00:08:54.101 "pending_free_request": 0, 00:08:54.101 "pending_rdma_read": 0, 00:08:54.101 "pending_rdma_write": 0, 00:08:54.101 "pending_rdma_send": 0, 00:08:54.101 "total_send_wrs": 0, 00:08:54.101 "send_doorbell_updates": 0, 00:08:54.101 "total_recv_wrs": 4096, 00:08:54.101 "recv_doorbell_updates": 1 00:08:54.101 }, 00:08:54.101 { 00:08:54.101 "name": "mlx5_1", 00:08:54.101 "polls": 15291, 00:08:54.101 "idle_polls": 15291, 00:08:54.101 "completions": 0, 00:08:54.101 "requests": 0, 00:08:54.101 "request_latency": 0, 00:08:54.101 "pending_free_request": 0, 00:08:54.101 "pending_rdma_read": 0, 00:08:54.101 "pending_rdma_write": 0, 00:08:54.101 "pending_rdma_send": 0, 00:08:54.101 "total_send_wrs": 0, 00:08:54.101 "send_doorbell_updates": 0, 00:08:54.101 "total_recv_wrs": 4096, 00:08:54.101 "recv_doorbell_updates": 1 00:08:54.101 } 00:08:54.101 ] 00:08:54.101 } 00:08:54.101 ] 00:08:54.101 }, 00:08:54.101 { 00:08:54.101 "name": "nvmf_tgt_poll_group_1", 00:08:54.101 "admin_qpairs": 0, 00:08:54.101 "io_qpairs": 0, 00:08:54.101 "current_admin_qpairs": 0, 00:08:54.101 "current_io_qpairs": 0, 00:08:54.101 "pending_bdev_io": 0, 00:08:54.101 "completed_nvme_io": 0, 00:08:54.101 "transports": [ 00:08:54.101 { 00:08:54.101 "trtype": "RDMA", 00:08:54.101 "pending_data_buffer": 0, 00:08:54.101 "devices": [ 00:08:54.101 { 00:08:54.101 "name": "mlx5_0", 00:08:54.101 "polls": 9768, 00:08:54.101 "idle_polls": 9768, 00:08:54.101 "completions": 0, 00:08:54.101 "requests": 0, 00:08:54.101 "request_latency": 0, 00:08:54.101 "pending_free_request": 0, 00:08:54.101 "pending_rdma_read": 0, 00:08:54.101 "pending_rdma_write": 0, 00:08:54.101 "pending_rdma_send": 0, 00:08:54.101 "total_send_wrs": 0, 00:08:54.101 "send_doorbell_updates": 0, 00:08:54.101 "total_recv_wrs": 4096, 00:08:54.101 "recv_doorbell_updates": 1 00:08:54.101 }, 00:08:54.101 { 00:08:54.101 "name": "mlx5_1", 00:08:54.101 "polls": 9768, 00:08:54.101 "idle_polls": 9768, 00:08:54.101 "completions": 0, 00:08:54.101 "requests": 0, 00:08:54.101 "request_latency": 0, 00:08:54.101 "pending_free_request": 0, 00:08:54.101 "pending_rdma_read": 0, 00:08:54.101 "pending_rdma_write": 0, 00:08:54.101 "pending_rdma_send": 0, 00:08:54.101 "total_send_wrs": 0, 00:08:54.101 "send_doorbell_updates": 0, 00:08:54.101 "total_recv_wrs": 4096, 00:08:54.101 "recv_doorbell_updates": 1 00:08:54.101 } 00:08:54.101 ] 00:08:54.101 } 00:08:54.101 ] 00:08:54.101 }, 00:08:54.101 { 00:08:54.101 "name": "nvmf_tgt_poll_group_2", 00:08:54.101 "admin_qpairs": 0, 00:08:54.101 "io_qpairs": 0, 00:08:54.101 "current_admin_qpairs": 0, 00:08:54.101 "current_io_qpairs": 0, 00:08:54.101 "pending_bdev_io": 0, 00:08:54.101 "completed_nvme_io": 0, 00:08:54.101 "transports": [ 00:08:54.102 { 00:08:54.102 "trtype": "RDMA", 00:08:54.102 "pending_data_buffer": 0, 00:08:54.102 "devices": [ 00:08:54.102 { 00:08:54.102 "name": "mlx5_0", 00:08:54.102 "polls": 5355, 00:08:54.102 "idle_polls": 5355, 00:08:54.102 "completions": 0, 00:08:54.102 "requests": 0, 00:08:54.102 "request_latency": 0, 00:08:54.102 "pending_free_request": 0, 00:08:54.102 "pending_rdma_read": 0, 00:08:54.102 "pending_rdma_write": 0, 00:08:54.102 "pending_rdma_send": 0, 00:08:54.102 "total_send_wrs": 0, 00:08:54.102 "send_doorbell_updates": 0, 00:08:54.102 "total_recv_wrs": 4096, 00:08:54.102 "recv_doorbell_updates": 1 00:08:54.102 }, 00:08:54.102 { 00:08:54.102 "name": "mlx5_1", 00:08:54.102 "polls": 5355, 00:08:54.102 "idle_polls": 5355, 00:08:54.102 "completions": 0, 00:08:54.102 "requests": 0, 00:08:54.102 "request_latency": 0, 00:08:54.102 "pending_free_request": 0, 00:08:54.102 "pending_rdma_read": 0, 00:08:54.102 "pending_rdma_write": 0, 00:08:54.102 "pending_rdma_send": 0, 00:08:54.102 "total_send_wrs": 0, 00:08:54.102 "send_doorbell_updates": 0, 00:08:54.102 "total_recv_wrs": 4096, 00:08:54.102 "recv_doorbell_updates": 1 00:08:54.102 } 00:08:54.102 ] 00:08:54.102 } 00:08:54.102 ] 00:08:54.102 }, 00:08:54.102 { 00:08:54.102 "name": "nvmf_tgt_poll_group_3", 00:08:54.102 "admin_qpairs": 0, 00:08:54.102 "io_qpairs": 0, 00:08:54.102 "current_admin_qpairs": 0, 00:08:54.102 "current_io_qpairs": 0, 00:08:54.102 "pending_bdev_io": 0, 00:08:54.102 "completed_nvme_io": 0, 00:08:54.102 "transports": [ 00:08:54.102 { 00:08:54.102 "trtype": "RDMA", 00:08:54.102 "pending_data_buffer": 0, 00:08:54.102 "devices": [ 00:08:54.102 { 00:08:54.102 "name": "mlx5_0", 00:08:54.102 "polls": 884, 00:08:54.102 "idle_polls": 884, 00:08:54.102 "completions": 0, 00:08:54.102 "requests": 0, 00:08:54.102 "request_latency": 0, 00:08:54.102 "pending_free_request": 0, 00:08:54.102 "pending_rdma_read": 0, 00:08:54.102 "pending_rdma_write": 0, 00:08:54.102 "pending_rdma_send": 0, 00:08:54.102 "total_send_wrs": 0, 00:08:54.102 "send_doorbell_updates": 0, 00:08:54.102 "total_recv_wrs": 4096, 00:08:54.102 "recv_doorbell_updates": 1 00:08:54.102 }, 00:08:54.102 { 00:08:54.102 "name": "mlx5_1", 00:08:54.102 "polls": 884, 00:08:54.102 "idle_polls": 884, 00:08:54.102 "completions": 0, 00:08:54.102 "requests": 0, 00:08:54.102 "request_latency": 0, 00:08:54.102 "pending_free_request": 0, 00:08:54.102 "pending_rdma_read": 0, 00:08:54.102 "pending_rdma_write": 0, 00:08:54.102 "pending_rdma_send": 0, 00:08:54.102 "total_send_wrs": 0, 00:08:54.102 "send_doorbell_updates": 0, 00:08:54.102 "total_recv_wrs": 4096, 00:08:54.102 "recv_doorbell_updates": 1 00:08:54.102 } 00:08:54.102 ] 00:08:54.102 } 00:08:54.102 ] 00:08:54.102 } 00:08:54.102 ] 00:08:54.102 }' 00:08:54.102 19:15:41 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:54.102 19:15:41 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:08:54.102 19:15:41 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:08:54.102 19:15:41 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:54.361 19:15:41 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:08:54.361 19:15:41 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:08:54.361 19:15:41 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:08:54.361 19:15:41 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:08:54.361 19:15:41 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:08:54.361 19:15:41 -- target/rpc.sh@15 -- # wc -l 00:08:54.361 19:15:41 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:08:54.361 19:15:41 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:08:54.361 19:15:41 -- target/rpc.sh@41 -- # transport_type=RDMA 00:08:54.361 19:15:41 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:08:54.361 19:15:41 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:08:54.361 19:15:41 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:08:54.361 19:15:41 -- target/rpc.sh@15 -- # wc -l 00:08:54.361 19:15:41 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:08:54.361 19:15:41 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:08:54.361 19:15:41 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:08:54.361 19:15:41 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:08:54.361 19:15:41 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:08:54.361 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.361 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.361 Malloc1 00:08:54.361 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.361 19:15:41 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:54.361 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.361 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.361 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.361 19:15:41 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:54.361 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.361 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.361 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.361 19:15:41 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:08:54.361 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.361 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.361 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.361 19:15:41 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:54.361 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.361 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.361 [2024-04-24 19:15:41.340080] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:54.361 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.361 19:15:41 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:54.361 19:15:41 -- common/autotest_common.sh@638 -- # local es=0 00:08:54.361 19:15:41 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:54.361 19:15:41 -- common/autotest_common.sh@626 -- # local arg=nvme 00:08:54.361 19:15:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:54.361 19:15:41 -- common/autotest_common.sh@630 -- # type -t nvme 00:08:54.361 19:15:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:54.361 19:15:41 -- common/autotest_common.sh@632 -- # type -P nvme 00:08:54.361 19:15:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:54.361 19:15:41 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:08:54.361 19:15:41 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:08:54.361 19:15:41 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:54.620 [2024-04-24 19:15:41.385898] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562' 00:08:54.620 Failed to write to /dev/nvme-fabrics: Input/output error 00:08:54.620 could not add new controller: failed to write to nvme-fabrics device 00:08:54.620 19:15:41 -- common/autotest_common.sh@641 -- # es=1 00:08:54.620 19:15:41 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:54.620 19:15:41 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:54.620 19:15:41 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:54.620 19:15:41 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:54.620 19:15:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:54.620 19:15:41 -- common/autotest_common.sh@10 -- # set +x 00:08:54.620 19:15:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:54.620 19:15:41 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:55.554 19:15:42 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:08:55.554 19:15:42 -- common/autotest_common.sh@1184 -- # local i=0 00:08:55.554 19:15:42 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:55.554 19:15:42 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:55.554 19:15:42 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:57.454 19:15:44 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:57.454 19:15:44 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:57.454 19:15:44 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:57.454 19:15:44 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:57.454 19:15:44 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:57.454 19:15:44 -- common/autotest_common.sh@1194 -- # return 0 00:08:57.454 19:15:44 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:58.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.389 19:15:45 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:58.389 19:15:45 -- common/autotest_common.sh@1205 -- # local i=0 00:08:58.389 19:15:45 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:58.389 19:15:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:58.389 19:15:45 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:58.389 19:15:45 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:58.647 19:15:45 -- common/autotest_common.sh@1217 -- # return 0 00:08:58.647 19:15:45 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:08:58.647 19:15:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.647 19:15:45 -- common/autotest_common.sh@10 -- # set +x 00:08:58.647 19:15:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.647 19:15:45 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:58.647 19:15:45 -- common/autotest_common.sh@638 -- # local es=0 00:08:58.647 19:15:45 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:58.647 19:15:45 -- common/autotest_common.sh@626 -- # local arg=nvme 00:08:58.647 19:15:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:58.647 19:15:45 -- common/autotest_common.sh@630 -- # type -t nvme 00:08:58.647 19:15:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:58.647 19:15:45 -- common/autotest_common.sh@632 -- # type -P nvme 00:08:58.647 19:15:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:58.647 19:15:45 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:08:58.647 19:15:45 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:08:58.647 19:15:45 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:58.647 [2024-04-24 19:15:45.467836] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562' 00:08:58.647 Failed to write to /dev/nvme-fabrics: Input/output error 00:08:58.647 could not add new controller: failed to write to nvme-fabrics device 00:08:58.647 19:15:45 -- common/autotest_common.sh@641 -- # es=1 00:08:58.647 19:15:45 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:58.647 19:15:45 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:58.647 19:15:45 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:58.647 19:15:45 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:08:58.647 19:15:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.647 19:15:45 -- common/autotest_common.sh@10 -- # set +x 00:08:58.647 19:15:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.647 19:15:45 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:59.580 19:15:46 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:08:59.580 19:15:46 -- common/autotest_common.sh@1184 -- # local i=0 00:08:59.580 19:15:46 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:59.580 19:15:46 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:59.580 19:15:46 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:01.480 19:15:48 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:01.480 19:15:48 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:01.739 19:15:48 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:01.739 19:15:48 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:01.739 19:15:48 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:01.739 19:15:48 -- common/autotest_common.sh@1194 -- # return 0 00:09:01.739 19:15:48 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:02.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.674 19:15:49 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:02.674 19:15:49 -- common/autotest_common.sh@1205 -- # local i=0 00:09:02.674 19:15:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:02.674 19:15:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:02.674 19:15:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:02.674 19:15:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:02.674 19:15:49 -- common/autotest_common.sh@1217 -- # return 0 00:09:02.674 19:15:49 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:02.674 19:15:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.674 19:15:49 -- common/autotest_common.sh@10 -- # set +x 00:09:02.674 19:15:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.674 19:15:49 -- target/rpc.sh@81 -- # seq 1 5 00:09:02.674 19:15:49 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:02.674 19:15:49 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:02.674 19:15:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.674 19:15:49 -- common/autotest_common.sh@10 -- # set +x 00:09:02.674 19:15:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.674 19:15:49 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:02.674 19:15:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.674 19:15:49 -- common/autotest_common.sh@10 -- # set +x 00:09:02.674 [2024-04-24 19:15:49.553373] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:02.674 19:15:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.674 19:15:49 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:02.674 19:15:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.674 19:15:49 -- common/autotest_common.sh@10 -- # set +x 00:09:02.674 19:15:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.674 19:15:49 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:02.674 19:15:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.674 19:15:49 -- common/autotest_common.sh@10 -- # set +x 00:09:02.674 19:15:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.674 19:15:49 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:03.609 19:15:50 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:03.609 19:15:50 -- common/autotest_common.sh@1184 -- # local i=0 00:09:03.609 19:15:50 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:03.609 19:15:50 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:03.609 19:15:50 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:06.139 19:15:52 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:06.139 19:15:52 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:06.139 19:15:52 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:06.139 19:15:52 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:06.139 19:15:52 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:06.139 19:15:52 -- common/autotest_common.sh@1194 -- # return 0 00:09:06.139 19:15:52 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:06.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.705 19:15:53 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:06.705 19:15:53 -- common/autotest_common.sh@1205 -- # local i=0 00:09:06.705 19:15:53 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:06.705 19:15:53 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:06.705 19:15:53 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:06.705 19:15:53 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:06.705 19:15:53 -- common/autotest_common.sh@1217 -- # return 0 00:09:06.705 19:15:53 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:06.705 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.705 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.705 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.705 19:15:53 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:06.705 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.705 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.705 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.705 19:15:53 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:06.705 19:15:53 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:06.706 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.706 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.706 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.706 19:15:53 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:06.706 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.706 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.706 [2024-04-24 19:15:53.598285] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:06.706 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.706 19:15:53 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:06.706 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.706 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.706 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.706 19:15:53 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:06.706 19:15:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.706 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:09:06.706 19:15:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.706 19:15:53 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:07.638 19:15:54 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:07.638 19:15:54 -- common/autotest_common.sh@1184 -- # local i=0 00:09:07.638 19:15:54 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:07.638 19:15:54 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:07.638 19:15:54 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:10.169 19:15:56 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:10.169 19:15:56 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:10.169 19:15:56 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:10.169 19:15:56 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:10.169 19:15:56 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:10.169 19:15:56 -- common/autotest_common.sh@1194 -- # return 0 00:09:10.169 19:15:56 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:10.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.735 19:15:57 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:10.735 19:15:57 -- common/autotest_common.sh@1205 -- # local i=0 00:09:10.735 19:15:57 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:10.735 19:15:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:10.735 19:15:57 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:10.735 19:15:57 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:10.735 19:15:57 -- common/autotest_common.sh@1217 -- # return 0 00:09:10.735 19:15:57 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:10.735 19:15:57 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 [2024-04-24 19:15:57.663154] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:10.735 19:15:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:10.735 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:09:10.735 19:15:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:10.735 19:15:57 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:11.668 19:15:58 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:11.668 19:15:58 -- common/autotest_common.sh@1184 -- # local i=0 00:09:11.668 19:15:58 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:11.668 19:15:58 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:11.668 19:15:58 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:14.190 19:16:00 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:14.190 19:16:00 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:14.190 19:16:00 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:14.190 19:16:00 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:14.191 19:16:00 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:14.191 19:16:00 -- common/autotest_common.sh@1194 -- # return 0 00:09:14.191 19:16:00 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:14.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.756 19:16:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:14.756 19:16:01 -- common/autotest_common.sh@1205 -- # local i=0 00:09:14.756 19:16:01 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:14.756 19:16:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:14.756 19:16:01 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:14.756 19:16:01 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:14.756 19:16:01 -- common/autotest_common.sh@1217 -- # return 0 00:09:14.756 19:16:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:14.756 19:16:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 [2024-04-24 19:16:01.706855] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:14.756 19:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:14.756 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:09:14.756 19:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:14.756 19:16:01 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:15.690 19:16:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:15.690 19:16:02 -- common/autotest_common.sh@1184 -- # local i=0 00:09:15.690 19:16:02 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:15.690 19:16:02 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:15.690 19:16:02 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:18.215 19:16:04 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:18.215 19:16:04 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:18.215 19:16:04 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:18.215 19:16:04 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:18.215 19:16:04 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:18.215 19:16:04 -- common/autotest_common.sh@1194 -- # return 0 00:09:18.215 19:16:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:18.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.780 19:16:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:18.780 19:16:05 -- common/autotest_common.sh@1205 -- # local i=0 00:09:18.780 19:16:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:18.780 19:16:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.780 19:16:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:18.780 19:16:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.780 19:16:05 -- common/autotest_common.sh@1217 -- # return 0 00:09:18.780 19:16:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:18.780 19:16:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 [2024-04-24 19:16:05.750740] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:18.780 19:16:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:18.780 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:09:18.780 19:16:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:18.780 19:16:05 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:20.153 19:16:06 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:20.153 19:16:06 -- common/autotest_common.sh@1184 -- # local i=0 00:09:20.153 19:16:06 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:20.153 19:16:06 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:20.153 19:16:06 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:22.052 19:16:08 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:22.052 19:16:08 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:22.052 19:16:08 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:22.052 19:16:08 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:22.052 19:16:08 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:22.052 19:16:08 -- common/autotest_common.sh@1194 -- # return 0 00:09:22.052 19:16:08 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:23.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.034 19:16:09 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@1205 -- # local i=0 00:09:23.034 19:16:09 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:23.034 19:16:09 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:23.034 19:16:09 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@1217 -- # return 0 00:09:23.034 19:16:09 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@99 -- # seq 1 5 00:09:23.034 19:16:09 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:23.034 19:16:09 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 [2024-04-24 19:16:09.815298] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:23.034 19:16:09 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 [2024-04-24 19:16:09.863613] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:23.034 19:16:09 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 [2024-04-24 19:16:09.911794] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:23.034 19:16:09 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 [2024-04-24 19:16:09.964005] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.034 19:16:09 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:23.034 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.034 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.034 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:09 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:23.035 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:09 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.035 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:09 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.035 19:16:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:09 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:23.035 19:16:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 [2024-04-24 19:16:10.012177] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:23.035 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.035 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.035 19:16:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.035 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.035 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.308 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.308 19:16:10 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:09:23.308 19:16:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.308 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.308 19:16:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.308 19:16:10 -- target/rpc.sh@110 -- # stats='{ 00:09:23.308 "tick_rate": 2300000000, 00:09:23.308 "poll_groups": [ 00:09:23.308 { 00:09:23.308 "name": "nvmf_tgt_poll_group_0", 00:09:23.308 "admin_qpairs": 2, 00:09:23.308 "io_qpairs": 27, 00:09:23.308 "current_admin_qpairs": 0, 00:09:23.308 "current_io_qpairs": 0, 00:09:23.308 "pending_bdev_io": 0, 00:09:23.308 "completed_nvme_io": 78, 00:09:23.308 "transports": [ 00:09:23.308 { 00:09:23.308 "trtype": "RDMA", 00:09:23.308 "pending_data_buffer": 0, 00:09:23.308 "devices": [ 00:09:23.308 { 00:09:23.308 "name": "mlx5_0", 00:09:23.308 "polls": 3440622, 00:09:23.308 "idle_polls": 3440371, 00:09:23.308 "completions": 271, 00:09:23.308 "requests": 135, 00:09:23.308 "request_latency": 21669820, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 213, 00:09:23.308 "send_doorbell_updates": 124, 00:09:23.308 "total_recv_wrs": 4231, 00:09:23.308 "recv_doorbell_updates": 124 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "mlx5_1", 00:09:23.308 "polls": 3440622, 00:09:23.308 "idle_polls": 3440622, 00:09:23.308 "completions": 0, 00:09:23.308 "requests": 0, 00:09:23.308 "request_latency": 0, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 0, 00:09:23.308 "send_doorbell_updates": 0, 00:09:23.308 "total_recv_wrs": 4096, 00:09:23.308 "recv_doorbell_updates": 1 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "nvmf_tgt_poll_group_1", 00:09:23.308 "admin_qpairs": 2, 00:09:23.308 "io_qpairs": 26, 00:09:23.308 "current_admin_qpairs": 0, 00:09:23.308 "current_io_qpairs": 0, 00:09:23.308 "pending_bdev_io": 0, 00:09:23.308 "completed_nvme_io": 226, 00:09:23.308 "transports": [ 00:09:23.308 { 00:09:23.308 "trtype": "RDMA", 00:09:23.308 "pending_data_buffer": 0, 00:09:23.308 "devices": [ 00:09:23.308 { 00:09:23.308 "name": "mlx5_0", 00:09:23.308 "polls": 3418882, 00:09:23.308 "idle_polls": 3418394, 00:09:23.308 "completions": 564, 00:09:23.308 "requests": 282, 00:09:23.308 "request_latency": 59575124, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 508, 00:09:23.308 "send_doorbell_updates": 238, 00:09:23.308 "total_recv_wrs": 4378, 00:09:23.308 "recv_doorbell_updates": 239 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "mlx5_1", 00:09:23.308 "polls": 3418882, 00:09:23.308 "idle_polls": 3418882, 00:09:23.308 "completions": 0, 00:09:23.308 "requests": 0, 00:09:23.308 "request_latency": 0, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 0, 00:09:23.308 "send_doorbell_updates": 0, 00:09:23.308 "total_recv_wrs": 4096, 00:09:23.308 "recv_doorbell_updates": 1 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "nvmf_tgt_poll_group_2", 00:09:23.308 "admin_qpairs": 1, 00:09:23.308 "io_qpairs": 26, 00:09:23.308 "current_admin_qpairs": 0, 00:09:23.308 "current_io_qpairs": 0, 00:09:23.308 "pending_bdev_io": 0, 00:09:23.308 "completed_nvme_io": 27, 00:09:23.308 "transports": [ 00:09:23.308 { 00:09:23.308 "trtype": "RDMA", 00:09:23.308 "pending_data_buffer": 0, 00:09:23.308 "devices": [ 00:09:23.308 { 00:09:23.308 "name": "mlx5_0", 00:09:23.308 "polls": 3560513, 00:09:23.308 "idle_polls": 3560400, 00:09:23.308 "completions": 113, 00:09:23.308 "requests": 56, 00:09:23.308 "request_latency": 5896738, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 71, 00:09:23.308 "send_doorbell_updates": 57, 00:09:23.308 "total_recv_wrs": 4152, 00:09:23.308 "recv_doorbell_updates": 57 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "mlx5_1", 00:09:23.308 "polls": 3560513, 00:09:23.308 "idle_polls": 3560513, 00:09:23.308 "completions": 0, 00:09:23.308 "requests": 0, 00:09:23.308 "request_latency": 0, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 0, 00:09:23.308 "send_doorbell_updates": 0, 00:09:23.308 "total_recv_wrs": 4096, 00:09:23.308 "recv_doorbell_updates": 1 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "nvmf_tgt_poll_group_3", 00:09:23.308 "admin_qpairs": 2, 00:09:23.308 "io_qpairs": 26, 00:09:23.308 "current_admin_qpairs": 0, 00:09:23.308 "current_io_qpairs": 0, 00:09:23.308 "pending_bdev_io": 0, 00:09:23.308 "completed_nvme_io": 124, 00:09:23.308 "transports": [ 00:09:23.308 { 00:09:23.308 "trtype": "RDMA", 00:09:23.308 "pending_data_buffer": 0, 00:09:23.308 "devices": [ 00:09:23.308 { 00:09:23.308 "name": "mlx5_0", 00:09:23.308 "polls": 2780270, 00:09:23.308 "idle_polls": 2779962, 00:09:23.308 "completions": 356, 00:09:23.308 "requests": 178, 00:09:23.308 "request_latency": 37513830, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 302, 00:09:23.308 "send_doorbell_updates": 154, 00:09:23.308 "total_recv_wrs": 4274, 00:09:23.308 "recv_doorbell_updates": 155 00:09:23.308 }, 00:09:23.308 { 00:09:23.308 "name": "mlx5_1", 00:09:23.308 "polls": 2780270, 00:09:23.308 "idle_polls": 2780270, 00:09:23.308 "completions": 0, 00:09:23.308 "requests": 0, 00:09:23.308 "request_latency": 0, 00:09:23.308 "pending_free_request": 0, 00:09:23.308 "pending_rdma_read": 0, 00:09:23.308 "pending_rdma_write": 0, 00:09:23.308 "pending_rdma_send": 0, 00:09:23.308 "total_send_wrs": 0, 00:09:23.308 "send_doorbell_updates": 0, 00:09:23.308 "total_recv_wrs": 4096, 00:09:23.308 "recv_doorbell_updates": 1 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 } 00:09:23.308 ] 00:09:23.308 }' 00:09:23.308 19:16:10 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:23.308 19:16:10 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:09:23.308 19:16:10 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:23.308 19:16:10 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:09:23.308 19:16:10 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:09:23.308 19:16:10 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:09:23.308 19:16:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:23.308 19:16:10 -- target/rpc.sh@117 -- # (( 1304 > 0 )) 00:09:23.308 19:16:10 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:09:23.308 19:16:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:09:23.308 19:16:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:23.308 19:16:10 -- target/rpc.sh@118 -- # (( 124655512 > 0 )) 00:09:23.308 19:16:10 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:09:23.308 19:16:10 -- target/rpc.sh@123 -- # nvmftestfini 00:09:23.308 19:16:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:23.308 19:16:10 -- nvmf/common.sh@117 -- # sync 00:09:23.308 19:16:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:23.308 19:16:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:23.308 19:16:10 -- nvmf/common.sh@120 -- # set +e 00:09:23.308 19:16:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:23.308 19:16:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:23.308 rmmod nvme_rdma 00:09:23.308 rmmod nvme_fabrics 00:09:23.579 19:16:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:23.579 19:16:10 -- nvmf/common.sh@124 -- # set -e 00:09:23.579 19:16:10 -- nvmf/common.sh@125 -- # return 0 00:09:23.579 19:16:10 -- nvmf/common.sh@478 -- # '[' -n 2932529 ']' 00:09:23.579 19:16:10 -- nvmf/common.sh@479 -- # killprocess 2932529 00:09:23.579 19:16:10 -- common/autotest_common.sh@936 -- # '[' -z 2932529 ']' 00:09:23.579 19:16:10 -- common/autotest_common.sh@940 -- # kill -0 2932529 00:09:23.579 19:16:10 -- common/autotest_common.sh@941 -- # uname 00:09:23.579 19:16:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:23.579 19:16:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2932529 00:09:23.579 19:16:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:23.579 19:16:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:23.579 19:16:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2932529' 00:09:23.579 killing process with pid 2932529 00:09:23.579 19:16:10 -- common/autotest_common.sh@955 -- # kill 2932529 00:09:23.579 19:16:10 -- common/autotest_common.sh@960 -- # wait 2932529 00:09:23.579 [2024-04-24 19:16:10.469163] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:23.837 19:16:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:23.837 19:16:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:23.837 00:09:23.837 real 0m37.051s 00:09:23.837 user 2m4.132s 00:09:23.837 sys 0m6.363s 00:09:23.837 19:16:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:23.837 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:23.837 ************************************ 00:09:23.837 END TEST nvmf_rpc 00:09:23.837 ************************************ 00:09:23.837 19:16:10 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:09:23.837 19:16:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:23.837 19:16:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:23.837 19:16:10 -- common/autotest_common.sh@10 -- # set +x 00:09:24.096 ************************************ 00:09:24.096 START TEST nvmf_invalid 00:09:24.096 ************************************ 00:09:24.096 19:16:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:09:24.096 * Looking for test storage... 00:09:24.096 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:24.096 19:16:11 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:24.096 19:16:11 -- nvmf/common.sh@7 -- # uname -s 00:09:24.096 19:16:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:24.096 19:16:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:24.096 19:16:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:24.096 19:16:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:24.096 19:16:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:24.096 19:16:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:24.096 19:16:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:24.096 19:16:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:24.096 19:16:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:24.096 19:16:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:24.096 19:16:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:09:24.096 19:16:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:09:24.096 19:16:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:24.096 19:16:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:24.096 19:16:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:24.096 19:16:11 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:24.097 19:16:11 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:24.097 19:16:11 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:24.097 19:16:11 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:24.097 19:16:11 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:24.097 19:16:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.097 19:16:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.097 19:16:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.097 19:16:11 -- paths/export.sh@5 -- # export PATH 00:09:24.097 19:16:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:24.097 19:16:11 -- nvmf/common.sh@47 -- # : 0 00:09:24.097 19:16:11 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:24.097 19:16:11 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:24.097 19:16:11 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:24.097 19:16:11 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:24.097 19:16:11 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:24.097 19:16:11 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:24.097 19:16:11 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:24.097 19:16:11 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:24.097 19:16:11 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:09:24.097 19:16:11 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:09:24.097 19:16:11 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:09:24.097 19:16:11 -- target/invalid.sh@14 -- # target=foobar 00:09:24.097 19:16:11 -- target/invalid.sh@16 -- # RANDOM=0 00:09:24.097 19:16:11 -- target/invalid.sh@34 -- # nvmftestinit 00:09:24.097 19:16:11 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:24.097 19:16:11 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:24.097 19:16:11 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:24.097 19:16:11 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:24.097 19:16:11 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:24.097 19:16:11 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:24.097 19:16:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:24.097 19:16:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:24.097 19:16:11 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:24.097 19:16:11 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:24.097 19:16:11 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:24.097 19:16:11 -- common/autotest_common.sh@10 -- # set +x 00:09:29.366 19:16:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:29.366 19:16:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:29.366 19:16:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:29.366 19:16:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:29.366 19:16:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:29.366 19:16:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:29.366 19:16:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:29.366 19:16:16 -- nvmf/common.sh@295 -- # net_devs=() 00:09:29.366 19:16:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:29.366 19:16:16 -- nvmf/common.sh@296 -- # e810=() 00:09:29.366 19:16:16 -- nvmf/common.sh@296 -- # local -ga e810 00:09:29.366 19:16:16 -- nvmf/common.sh@297 -- # x722=() 00:09:29.366 19:16:16 -- nvmf/common.sh@297 -- # local -ga x722 00:09:29.366 19:16:16 -- nvmf/common.sh@298 -- # mlx=() 00:09:29.366 19:16:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:29.366 19:16:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:29.366 19:16:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:29.366 19:16:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:29.366 19:16:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:29.366 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:29.366 19:16:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:29.366 19:16:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:29.366 19:16:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:29.366 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:29.366 19:16:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:29.366 19:16:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:29.366 19:16:16 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:29.366 19:16:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:29.366 19:16:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:29.366 19:16:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:29.366 19:16:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:29.366 Found net devices under 0000:18:00.0: mlx_0_0 00:09:29.366 19:16:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:29.366 19:16:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:29.366 19:16:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:29.366 19:16:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:29.366 19:16:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:29.366 Found net devices under 0000:18:00.1: mlx_0_1 00:09:29.366 19:16:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:29.366 19:16:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:29.366 19:16:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:29.366 19:16:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:29.366 19:16:16 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:29.366 19:16:16 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:29.366 19:16:16 -- nvmf/common.sh@58 -- # uname 00:09:29.366 19:16:16 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:29.625 19:16:16 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:29.625 19:16:16 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:29.625 19:16:16 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:29.625 19:16:16 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:29.625 19:16:16 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:29.625 19:16:16 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:29.625 19:16:16 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:29.625 19:16:16 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:29.625 19:16:16 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:29.625 19:16:16 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:29.625 19:16:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:29.625 19:16:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:29.625 19:16:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:29.625 19:16:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:29.625 19:16:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:29.625 19:16:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:29.625 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.625 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:29.625 19:16:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@105 -- # continue 2 00:09:29.626 19:16:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@105 -- # continue 2 00:09:29.626 19:16:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:29.626 19:16:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:29.626 19:16:16 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:29.626 19:16:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:29.626 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:29.626 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:09:29.626 altname enp24s0f0np0 00:09:29.626 altname ens785f0np0 00:09:29.626 inet 192.168.100.8/24 scope global mlx_0_0 00:09:29.626 valid_lft forever preferred_lft forever 00:09:29.626 19:16:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:29.626 19:16:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:29.626 19:16:16 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:29.626 19:16:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:29.626 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:29.626 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:09:29.626 altname enp24s0f1np1 00:09:29.626 altname ens785f1np1 00:09:29.626 inet 192.168.100.9/24 scope global mlx_0_1 00:09:29.626 valid_lft forever preferred_lft forever 00:09:29.626 19:16:16 -- nvmf/common.sh@411 -- # return 0 00:09:29.626 19:16:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:29.626 19:16:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:29.626 19:16:16 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:29.626 19:16:16 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:29.626 19:16:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:29.626 19:16:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:29.626 19:16:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:29.626 19:16:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:29.626 19:16:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:29.626 19:16:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@105 -- # continue 2 00:09:29.626 19:16:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:29.626 19:16:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:29.626 19:16:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@105 -- # continue 2 00:09:29.626 19:16:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:29.626 19:16:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:29.626 19:16:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:29.626 19:16:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:29.626 19:16:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:29.626 19:16:16 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:29.626 192.168.100.9' 00:09:29.626 19:16:16 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:29.626 192.168.100.9' 00:09:29.626 19:16:16 -- nvmf/common.sh@446 -- # head -n 1 00:09:29.626 19:16:16 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:29.626 19:16:16 -- nvmf/common.sh@447 -- # head -n 1 00:09:29.626 19:16:16 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:29.626 192.168.100.9' 00:09:29.626 19:16:16 -- nvmf/common.sh@447 -- # tail -n +2 00:09:29.626 19:16:16 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:29.626 19:16:16 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:29.626 19:16:16 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:29.626 19:16:16 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:29.626 19:16:16 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:29.626 19:16:16 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:29.626 19:16:16 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:09:29.626 19:16:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:29.626 19:16:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:29.626 19:16:16 -- common/autotest_common.sh@10 -- # set +x 00:09:29.626 19:16:16 -- nvmf/common.sh@470 -- # nvmfpid=2939476 00:09:29.626 19:16:16 -- nvmf/common.sh@471 -- # waitforlisten 2939476 00:09:29.626 19:16:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:29.626 19:16:16 -- common/autotest_common.sh@817 -- # '[' -z 2939476 ']' 00:09:29.626 19:16:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:29.626 19:16:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:29.626 19:16:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:29.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:29.626 19:16:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:29.626 19:16:16 -- common/autotest_common.sh@10 -- # set +x 00:09:29.886 [2024-04-24 19:16:16.646648] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:09:29.886 [2024-04-24 19:16:16.646711] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:29.886 EAL: No free 2048 kB hugepages reported on node 1 00:09:29.886 [2024-04-24 19:16:16.720994] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:29.886 [2024-04-24 19:16:16.801020] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:29.886 [2024-04-24 19:16:16.801064] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:29.886 [2024-04-24 19:16:16.801077] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:29.886 [2024-04-24 19:16:16.801102] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:29.886 [2024-04-24 19:16:16.801109] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:29.886 [2024-04-24 19:16:16.801170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:29.886 [2024-04-24 19:16:16.801269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:29.886 [2024-04-24 19:16:16.801349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:29.886 [2024-04-24 19:16:16.801351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:30.453 19:16:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:30.453 19:16:17 -- common/autotest_common.sh@850 -- # return 0 00:09:30.453 19:16:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:30.453 19:16:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:30.453 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:09:30.711 19:16:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:30.711 19:16:17 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:09:30.711 19:16:17 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode16524 00:09:30.711 [2024-04-24 19:16:17.662052] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:09:30.711 19:16:17 -- target/invalid.sh@40 -- # out='request: 00:09:30.711 { 00:09:30.711 "nqn": "nqn.2016-06.io.spdk:cnode16524", 00:09:30.711 "tgt_name": "foobar", 00:09:30.711 "method": "nvmf_create_subsystem", 00:09:30.711 "req_id": 1 00:09:30.711 } 00:09:30.711 Got JSON-RPC error response 00:09:30.711 response: 00:09:30.711 { 00:09:30.711 "code": -32603, 00:09:30.711 "message": "Unable to find target foobar" 00:09:30.711 }' 00:09:30.711 19:16:17 -- target/invalid.sh@41 -- # [[ request: 00:09:30.711 { 00:09:30.711 "nqn": "nqn.2016-06.io.spdk:cnode16524", 00:09:30.711 "tgt_name": "foobar", 00:09:30.711 "method": "nvmf_create_subsystem", 00:09:30.711 "req_id": 1 00:09:30.711 } 00:09:30.711 Got JSON-RPC error response 00:09:30.711 response: 00:09:30.711 { 00:09:30.711 "code": -32603, 00:09:30.711 "message": "Unable to find target foobar" 00:09:30.711 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:09:30.711 19:16:17 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:09:30.711 19:16:17 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode32481 00:09:30.970 [2024-04-24 19:16:17.842697] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32481: invalid serial number 'SPDKISFASTANDAWESOME' 00:09:30.970 19:16:17 -- target/invalid.sh@45 -- # out='request: 00:09:30.970 { 00:09:30.970 "nqn": "nqn.2016-06.io.spdk:cnode32481", 00:09:30.970 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:09:30.970 "method": "nvmf_create_subsystem", 00:09:30.970 "req_id": 1 00:09:30.970 } 00:09:30.970 Got JSON-RPC error response 00:09:30.970 response: 00:09:30.970 { 00:09:30.970 "code": -32602, 00:09:30.970 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:09:30.970 }' 00:09:30.970 19:16:17 -- target/invalid.sh@46 -- # [[ request: 00:09:30.970 { 00:09:30.970 "nqn": "nqn.2016-06.io.spdk:cnode32481", 00:09:30.970 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:09:30.970 "method": "nvmf_create_subsystem", 00:09:30.970 "req_id": 1 00:09:30.970 } 00:09:30.970 Got JSON-RPC error response 00:09:30.970 response: 00:09:30.970 { 00:09:30.970 "code": -32602, 00:09:30.970 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:09:30.970 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:09:30.970 19:16:17 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:09:30.970 19:16:17 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode19020 00:09:31.228 [2024-04-24 19:16:18.043307] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19020: invalid model number 'SPDK_Controller' 00:09:31.228 19:16:18 -- target/invalid.sh@50 -- # out='request: 00:09:31.228 { 00:09:31.228 "nqn": "nqn.2016-06.io.spdk:cnode19020", 00:09:31.229 "model_number": "SPDK_Controller\u001f", 00:09:31.229 "method": "nvmf_create_subsystem", 00:09:31.229 "req_id": 1 00:09:31.229 } 00:09:31.229 Got JSON-RPC error response 00:09:31.229 response: 00:09:31.229 { 00:09:31.229 "code": -32602, 00:09:31.229 "message": "Invalid MN SPDK_Controller\u001f" 00:09:31.229 }' 00:09:31.229 19:16:18 -- target/invalid.sh@51 -- # [[ request: 00:09:31.229 { 00:09:31.229 "nqn": "nqn.2016-06.io.spdk:cnode19020", 00:09:31.229 "model_number": "SPDK_Controller\u001f", 00:09:31.229 "method": "nvmf_create_subsystem", 00:09:31.229 "req_id": 1 00:09:31.229 } 00:09:31.229 Got JSON-RPC error response 00:09:31.229 response: 00:09:31.229 { 00:09:31.229 "code": -32602, 00:09:31.229 "message": "Invalid MN SPDK_Controller\u001f" 00:09:31.229 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:09:31.229 19:16:18 -- target/invalid.sh@54 -- # gen_random_s 21 00:09:31.229 19:16:18 -- target/invalid.sh@19 -- # local length=21 ll 00:09:31.229 19:16:18 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:09:31.229 19:16:18 -- target/invalid.sh@21 -- # local chars 00:09:31.229 19:16:18 -- target/invalid.sh@22 -- # local string 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 119 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x77' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=w 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 71 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x47' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=G 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 88 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x58' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=X 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 49 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x31' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=1 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 95 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=_ 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 35 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x23' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+='#' 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 86 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x56' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=V 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 79 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=O 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 74 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=J 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 49 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x31' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=1 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 48 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x30' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=0 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 81 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x51' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=Q 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 50 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x32' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=2 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 119 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x77' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=w 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 98 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x62' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=b 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 88 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x58' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=X 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 65 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x41' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=A 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 116 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x74' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=t 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 75 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=K 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 87 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x57' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=W 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # printf %x 120 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x78' 00:09:31.229 19:16:18 -- target/invalid.sh@25 -- # string+=x 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.229 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.229 19:16:18 -- target/invalid.sh@28 -- # [[ w == \- ]] 00:09:31.229 19:16:18 -- target/invalid.sh@31 -- # echo wGX1_#VOJ10Q2wbXAtKWx 00:09:31.229 19:16:18 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s wGX1_#VOJ10Q2wbXAtKWx nqn.2016-06.io.spdk:cnode25941 00:09:31.488 [2024-04-24 19:16:18.404523] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25941: invalid serial number 'wGX1_#VOJ10Q2wbXAtKWx' 00:09:31.488 19:16:18 -- target/invalid.sh@54 -- # out='request: 00:09:31.488 { 00:09:31.488 "nqn": "nqn.2016-06.io.spdk:cnode25941", 00:09:31.488 "serial_number": "wGX1_#VOJ10Q2wbXAtKWx", 00:09:31.488 "method": "nvmf_create_subsystem", 00:09:31.488 "req_id": 1 00:09:31.488 } 00:09:31.488 Got JSON-RPC error response 00:09:31.488 response: 00:09:31.488 { 00:09:31.488 "code": -32602, 00:09:31.488 "message": "Invalid SN wGX1_#VOJ10Q2wbXAtKWx" 00:09:31.488 }' 00:09:31.488 19:16:18 -- target/invalid.sh@55 -- # [[ request: 00:09:31.488 { 00:09:31.488 "nqn": "nqn.2016-06.io.spdk:cnode25941", 00:09:31.488 "serial_number": "wGX1_#VOJ10Q2wbXAtKWx", 00:09:31.488 "method": "nvmf_create_subsystem", 00:09:31.488 "req_id": 1 00:09:31.488 } 00:09:31.488 Got JSON-RPC error response 00:09:31.488 response: 00:09:31.488 { 00:09:31.488 "code": -32602, 00:09:31.488 "message": "Invalid SN wGX1_#VOJ10Q2wbXAtKWx" 00:09:31.488 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:09:31.488 19:16:18 -- target/invalid.sh@58 -- # gen_random_s 41 00:09:31.488 19:16:18 -- target/invalid.sh@19 -- # local length=41 ll 00:09:31.488 19:16:18 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:09:31.488 19:16:18 -- target/invalid.sh@21 -- # local chars 00:09:31.488 19:16:18 -- target/invalid.sh@22 -- # local string 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 40 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x28' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+='(' 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 57 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x39' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=9 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 97 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x61' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=a 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 52 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x34' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=4 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 66 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x42' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=B 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 92 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+='\' 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 76 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=L 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 94 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+='^' 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # printf %x 107 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:09:31.488 19:16:18 -- target/invalid.sh@25 -- # string+=k 00:09:31.488 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 36 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x24' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+='$' 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 56 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x38' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=8 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 108 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=l 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 66 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x42' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=B 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 91 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+='[' 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 91 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+='[' 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 127 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=$'\177' 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 80 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x50' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=P 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 46 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=. 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 71 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x47' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=G 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 82 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x52' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=R 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 74 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=J 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 41 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x29' 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # string+=')' 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.747 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # printf %x 72 00:09:31.747 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x48' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=H 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 73 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x49' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=I 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 126 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+='~' 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 77 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=M 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 97 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x61' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=a 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 116 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x74' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=t 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 44 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=, 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 105 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x69' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=i 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 73 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x49' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=I 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 68 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x44' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=D 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 72 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x48' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=H 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 107 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=k 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 70 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x46' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=F 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 54 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x36' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=6 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 108 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=l 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 92 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+='\' 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 124 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+='|' 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 86 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x56' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=V 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # printf %x 85 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # echo -e '\x55' 00:09:31.748 19:16:18 -- target/invalid.sh@25 -- # string+=U 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:31.748 19:16:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:31.748 19:16:18 -- target/invalid.sh@28 -- # [[ ( == \- ]] 00:09:31.748 19:16:18 -- target/invalid.sh@31 -- # echo '(9a4B\L^k$8lB[[P.GRJ)HI~Mat,iIDHkF6l\|VU' 00:09:31.748 19:16:18 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '(9a4B\L^k$8lB[[P.GRJ)HI~Mat,iIDHkF6l\|VU' nqn.2016-06.io.spdk:cnode13546 00:09:32.006 [2024-04-24 19:16:18.914257] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13546: invalid model number '(9a4B\L^k$8lB[[P.GRJ)HI~Mat,iIDHkF6l\|VU' 00:09:32.006 19:16:18 -- target/invalid.sh@58 -- # out='request: 00:09:32.006 { 00:09:32.006 "nqn": "nqn.2016-06.io.spdk:cnode13546", 00:09:32.006 "model_number": "(9a4B\\L^k$8lB[[\u007fP.GRJ)HI~Mat,iIDHkF6l\\|VU", 00:09:32.006 "method": "nvmf_create_subsystem", 00:09:32.006 "req_id": 1 00:09:32.006 } 00:09:32.006 Got JSON-RPC error response 00:09:32.006 response: 00:09:32.006 { 00:09:32.006 "code": -32602, 00:09:32.006 "message": "Invalid MN (9a4B\\L^k$8lB[[\u007fP.GRJ)HI~Mat,iIDHkF6l\\|VU" 00:09:32.006 }' 00:09:32.006 19:16:18 -- target/invalid.sh@59 -- # [[ request: 00:09:32.006 { 00:09:32.006 "nqn": "nqn.2016-06.io.spdk:cnode13546", 00:09:32.006 "model_number": "(9a4B\\L^k$8lB[[\u007fP.GRJ)HI~Mat,iIDHkF6l\\|VU", 00:09:32.006 "method": "nvmf_create_subsystem", 00:09:32.006 "req_id": 1 00:09:32.006 } 00:09:32.006 Got JSON-RPC error response 00:09:32.006 response: 00:09:32.006 { 00:09:32.006 "code": -32602, 00:09:32.006 "message": "Invalid MN (9a4B\\L^k$8lB[[\u007fP.GRJ)HI~Mat,iIDHkF6l\\|VU" 00:09:32.007 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:09:32.007 19:16:18 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:09:32.265 [2024-04-24 19:16:19.121582] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1178920/0x117ce10) succeed. 00:09:32.265 [2024-04-24 19:16:19.132185] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1179f60/0x11be4a0) succeed. 00:09:32.265 19:16:19 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:09:32.523 19:16:19 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:09:32.523 19:16:19 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:09:32.523 192.168.100.9' 00:09:32.523 19:16:19 -- target/invalid.sh@67 -- # head -n 1 00:09:32.523 19:16:19 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:09:32.523 19:16:19 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:09:32.782 [2024-04-24 19:16:19.664154] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:09:32.782 19:16:19 -- target/invalid.sh@69 -- # out='request: 00:09:32.782 { 00:09:32.782 "nqn": "nqn.2016-06.io.spdk:cnode", 00:09:32.782 "listen_address": { 00:09:32.782 "trtype": "rdma", 00:09:32.782 "traddr": "192.168.100.8", 00:09:32.782 "trsvcid": "4421" 00:09:32.782 }, 00:09:32.782 "method": "nvmf_subsystem_remove_listener", 00:09:32.782 "req_id": 1 00:09:32.782 } 00:09:32.782 Got JSON-RPC error response 00:09:32.782 response: 00:09:32.782 { 00:09:32.782 "code": -32602, 00:09:32.782 "message": "Invalid parameters" 00:09:32.782 }' 00:09:32.782 19:16:19 -- target/invalid.sh@70 -- # [[ request: 00:09:32.782 { 00:09:32.782 "nqn": "nqn.2016-06.io.spdk:cnode", 00:09:32.782 "listen_address": { 00:09:32.782 "trtype": "rdma", 00:09:32.782 "traddr": "192.168.100.8", 00:09:32.782 "trsvcid": "4421" 00:09:32.782 }, 00:09:32.782 "method": "nvmf_subsystem_remove_listener", 00:09:32.782 "req_id": 1 00:09:32.782 } 00:09:32.782 Got JSON-RPC error response 00:09:32.782 response: 00:09:32.782 { 00:09:32.782 "code": -32602, 00:09:32.782 "message": "Invalid parameters" 00:09:32.782 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:09:32.782 19:16:19 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10367 -i 0 00:09:33.040 [2024-04-24 19:16:19.844751] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10367: invalid cntlid range [0-65519] 00:09:33.040 19:16:19 -- target/invalid.sh@73 -- # out='request: 00:09:33.040 { 00:09:33.040 "nqn": "nqn.2016-06.io.spdk:cnode10367", 00:09:33.040 "min_cntlid": 0, 00:09:33.040 "method": "nvmf_create_subsystem", 00:09:33.040 "req_id": 1 00:09:33.040 } 00:09:33.040 Got JSON-RPC error response 00:09:33.040 response: 00:09:33.040 { 00:09:33.040 "code": -32602, 00:09:33.040 "message": "Invalid cntlid range [0-65519]" 00:09:33.040 }' 00:09:33.040 19:16:19 -- target/invalid.sh@74 -- # [[ request: 00:09:33.040 { 00:09:33.040 "nqn": "nqn.2016-06.io.spdk:cnode10367", 00:09:33.040 "min_cntlid": 0, 00:09:33.040 "method": "nvmf_create_subsystem", 00:09:33.040 "req_id": 1 00:09:33.040 } 00:09:33.040 Got JSON-RPC error response 00:09:33.040 response: 00:09:33.040 { 00:09:33.040 "code": -32602, 00:09:33.040 "message": "Invalid cntlid range [0-65519]" 00:09:33.040 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:33.040 19:16:19 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16242 -i 65520 00:09:33.040 [2024-04-24 19:16:20.033412] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16242: invalid cntlid range [65520-65519] 00:09:33.298 19:16:20 -- target/invalid.sh@75 -- # out='request: 00:09:33.298 { 00:09:33.298 "nqn": "nqn.2016-06.io.spdk:cnode16242", 00:09:33.298 "min_cntlid": 65520, 00:09:33.298 "method": "nvmf_create_subsystem", 00:09:33.298 "req_id": 1 00:09:33.298 } 00:09:33.298 Got JSON-RPC error response 00:09:33.298 response: 00:09:33.298 { 00:09:33.298 "code": -32602, 00:09:33.298 "message": "Invalid cntlid range [65520-65519]" 00:09:33.298 }' 00:09:33.298 19:16:20 -- target/invalid.sh@76 -- # [[ request: 00:09:33.298 { 00:09:33.298 "nqn": "nqn.2016-06.io.spdk:cnode16242", 00:09:33.298 "min_cntlid": 65520, 00:09:33.298 "method": "nvmf_create_subsystem", 00:09:33.298 "req_id": 1 00:09:33.298 } 00:09:33.298 Got JSON-RPC error response 00:09:33.298 response: 00:09:33.298 { 00:09:33.298 "code": -32602, 00:09:33.298 "message": "Invalid cntlid range [65520-65519]" 00:09:33.298 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:33.298 19:16:20 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode878 -I 0 00:09:33.298 [2024-04-24 19:16:20.222134] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode878: invalid cntlid range [1-0] 00:09:33.298 19:16:20 -- target/invalid.sh@77 -- # out='request: 00:09:33.298 { 00:09:33.298 "nqn": "nqn.2016-06.io.spdk:cnode878", 00:09:33.298 "max_cntlid": 0, 00:09:33.298 "method": "nvmf_create_subsystem", 00:09:33.298 "req_id": 1 00:09:33.298 } 00:09:33.298 Got JSON-RPC error response 00:09:33.298 response: 00:09:33.298 { 00:09:33.298 "code": -32602, 00:09:33.298 "message": "Invalid cntlid range [1-0]" 00:09:33.298 }' 00:09:33.298 19:16:20 -- target/invalid.sh@78 -- # [[ request: 00:09:33.298 { 00:09:33.298 "nqn": "nqn.2016-06.io.spdk:cnode878", 00:09:33.298 "max_cntlid": 0, 00:09:33.298 "method": "nvmf_create_subsystem", 00:09:33.298 "req_id": 1 00:09:33.298 } 00:09:33.298 Got JSON-RPC error response 00:09:33.298 response: 00:09:33.298 { 00:09:33.298 "code": -32602, 00:09:33.298 "message": "Invalid cntlid range [1-0]" 00:09:33.298 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:33.298 19:16:20 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15423 -I 65520 00:09:33.556 [2024-04-24 19:16:20.410834] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15423: invalid cntlid range [1-65520] 00:09:33.556 19:16:20 -- target/invalid.sh@79 -- # out='request: 00:09:33.556 { 00:09:33.556 "nqn": "nqn.2016-06.io.spdk:cnode15423", 00:09:33.556 "max_cntlid": 65520, 00:09:33.556 "method": "nvmf_create_subsystem", 00:09:33.556 "req_id": 1 00:09:33.556 } 00:09:33.556 Got JSON-RPC error response 00:09:33.556 response: 00:09:33.556 { 00:09:33.556 "code": -32602, 00:09:33.556 "message": "Invalid cntlid range [1-65520]" 00:09:33.556 }' 00:09:33.556 19:16:20 -- target/invalid.sh@80 -- # [[ request: 00:09:33.556 { 00:09:33.556 "nqn": "nqn.2016-06.io.spdk:cnode15423", 00:09:33.556 "max_cntlid": 65520, 00:09:33.556 "method": "nvmf_create_subsystem", 00:09:33.556 "req_id": 1 00:09:33.556 } 00:09:33.556 Got JSON-RPC error response 00:09:33.556 response: 00:09:33.556 { 00:09:33.556 "code": -32602, 00:09:33.556 "message": "Invalid cntlid range [1-65520]" 00:09:33.556 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:33.556 19:16:20 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1095 -i 6 -I 5 00:09:33.814 [2024-04-24 19:16:20.599495] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1095: invalid cntlid range [6-5] 00:09:33.814 19:16:20 -- target/invalid.sh@83 -- # out='request: 00:09:33.814 { 00:09:33.814 "nqn": "nqn.2016-06.io.spdk:cnode1095", 00:09:33.814 "min_cntlid": 6, 00:09:33.814 "max_cntlid": 5, 00:09:33.814 "method": "nvmf_create_subsystem", 00:09:33.814 "req_id": 1 00:09:33.814 } 00:09:33.814 Got JSON-RPC error response 00:09:33.814 response: 00:09:33.814 { 00:09:33.814 "code": -32602, 00:09:33.814 "message": "Invalid cntlid range [6-5]" 00:09:33.814 }' 00:09:33.814 19:16:20 -- target/invalid.sh@84 -- # [[ request: 00:09:33.814 { 00:09:33.814 "nqn": "nqn.2016-06.io.spdk:cnode1095", 00:09:33.814 "min_cntlid": 6, 00:09:33.814 "max_cntlid": 5, 00:09:33.814 "method": "nvmf_create_subsystem", 00:09:33.814 "req_id": 1 00:09:33.814 } 00:09:33.814 Got JSON-RPC error response 00:09:33.814 response: 00:09:33.814 { 00:09:33.814 "code": -32602, 00:09:33.814 "message": "Invalid cntlid range [6-5]" 00:09:33.814 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:33.814 19:16:20 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:09:33.814 19:16:20 -- target/invalid.sh@87 -- # out='request: 00:09:33.814 { 00:09:33.814 "name": "foobar", 00:09:33.814 "method": "nvmf_delete_target", 00:09:33.814 "req_id": 1 00:09:33.814 } 00:09:33.814 Got JSON-RPC error response 00:09:33.814 response: 00:09:33.814 { 00:09:33.814 "code": -32602, 00:09:33.814 "message": "The specified target doesn'\''t exist, cannot delete it." 00:09:33.814 }' 00:09:33.814 19:16:20 -- target/invalid.sh@88 -- # [[ request: 00:09:33.814 { 00:09:33.814 "name": "foobar", 00:09:33.814 "method": "nvmf_delete_target", 00:09:33.814 "req_id": 1 00:09:33.814 } 00:09:33.814 Got JSON-RPC error response 00:09:33.814 response: 00:09:33.814 { 00:09:33.814 "code": -32602, 00:09:33.814 "message": "The specified target doesn't exist, cannot delete it." 00:09:33.814 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:09:33.814 19:16:20 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:09:33.814 19:16:20 -- target/invalid.sh@91 -- # nvmftestfini 00:09:33.814 19:16:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:33.814 19:16:20 -- nvmf/common.sh@117 -- # sync 00:09:33.814 19:16:20 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:33.814 19:16:20 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:33.814 19:16:20 -- nvmf/common.sh@120 -- # set +e 00:09:33.814 19:16:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:33.814 19:16:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:33.814 rmmod nvme_rdma 00:09:33.814 rmmod nvme_fabrics 00:09:33.814 19:16:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:33.814 19:16:20 -- nvmf/common.sh@124 -- # set -e 00:09:33.814 19:16:20 -- nvmf/common.sh@125 -- # return 0 00:09:33.814 19:16:20 -- nvmf/common.sh@478 -- # '[' -n 2939476 ']' 00:09:33.814 19:16:20 -- nvmf/common.sh@479 -- # killprocess 2939476 00:09:33.814 19:16:20 -- common/autotest_common.sh@936 -- # '[' -z 2939476 ']' 00:09:33.814 19:16:20 -- common/autotest_common.sh@940 -- # kill -0 2939476 00:09:33.814 19:16:20 -- common/autotest_common.sh@941 -- # uname 00:09:33.814 19:16:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:33.814 19:16:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2939476 00:09:34.072 19:16:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:34.072 19:16:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:34.072 19:16:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2939476' 00:09:34.072 killing process with pid 2939476 00:09:34.072 19:16:20 -- common/autotest_common.sh@955 -- # kill 2939476 00:09:34.072 19:16:20 -- common/autotest_common.sh@960 -- # wait 2939476 00:09:34.072 [2024-04-24 19:16:20.931278] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:34.331 19:16:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:34.331 19:16:21 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:34.331 00:09:34.331 real 0m10.210s 00:09:34.331 user 0m20.917s 00:09:34.331 sys 0m5.415s 00:09:34.331 19:16:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:34.331 19:16:21 -- common/autotest_common.sh@10 -- # set +x 00:09:34.331 ************************************ 00:09:34.331 END TEST nvmf_invalid 00:09:34.331 ************************************ 00:09:34.331 19:16:21 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:09:34.331 19:16:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:34.331 19:16:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:34.331 19:16:21 -- common/autotest_common.sh@10 -- # set +x 00:09:34.331 ************************************ 00:09:34.331 START TEST nvmf_abort 00:09:34.331 ************************************ 00:09:34.331 19:16:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:09:34.590 * Looking for test storage... 00:09:34.590 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:34.590 19:16:21 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:34.590 19:16:21 -- nvmf/common.sh@7 -- # uname -s 00:09:34.590 19:16:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:34.590 19:16:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:34.590 19:16:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:34.590 19:16:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:34.590 19:16:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:34.590 19:16:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:34.590 19:16:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:34.590 19:16:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:34.590 19:16:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:34.590 19:16:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:34.590 19:16:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:09:34.590 19:16:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:09:34.590 19:16:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:34.590 19:16:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:34.590 19:16:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:34.590 19:16:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:34.590 19:16:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:34.590 19:16:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:34.590 19:16:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:34.590 19:16:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:34.590 19:16:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:34.590 19:16:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:34.590 19:16:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:34.590 19:16:21 -- paths/export.sh@5 -- # export PATH 00:09:34.590 19:16:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:34.590 19:16:21 -- nvmf/common.sh@47 -- # : 0 00:09:34.590 19:16:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:34.590 19:16:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:34.590 19:16:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:34.590 19:16:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:34.590 19:16:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:34.590 19:16:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:34.590 19:16:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:34.590 19:16:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:34.590 19:16:21 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:34.590 19:16:21 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:09:34.590 19:16:21 -- target/abort.sh@14 -- # nvmftestinit 00:09:34.590 19:16:21 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:34.590 19:16:21 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:34.590 19:16:21 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:34.590 19:16:21 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:34.590 19:16:21 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:34.590 19:16:21 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:34.590 19:16:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:34.590 19:16:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:34.590 19:16:21 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:34.590 19:16:21 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:34.590 19:16:21 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:34.590 19:16:21 -- common/autotest_common.sh@10 -- # set +x 00:09:41.155 19:16:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:41.155 19:16:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:41.155 19:16:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:41.155 19:16:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:41.155 19:16:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:41.155 19:16:27 -- nvmf/common.sh@295 -- # net_devs=() 00:09:41.155 19:16:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@296 -- # e810=() 00:09:41.155 19:16:27 -- nvmf/common.sh@296 -- # local -ga e810 00:09:41.155 19:16:27 -- nvmf/common.sh@297 -- # x722=() 00:09:41.155 19:16:27 -- nvmf/common.sh@297 -- # local -ga x722 00:09:41.155 19:16:27 -- nvmf/common.sh@298 -- # mlx=() 00:09:41.155 19:16:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:41.155 19:16:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:41.155 19:16:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:41.155 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:41.155 19:16:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:41.155 19:16:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:41.155 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:41.155 19:16:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:41.155 19:16:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:41.155 19:16:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:41.155 19:16:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:41.155 Found net devices under 0000:18:00.0: mlx_0_0 00:09:41.155 19:16:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:41.155 19:16:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:41.155 19:16:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:41.155 Found net devices under 0000:18:00.1: mlx_0_1 00:09:41.155 19:16:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:41.155 19:16:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:41.155 19:16:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:41.155 19:16:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:41.155 19:16:27 -- nvmf/common.sh@58 -- # uname 00:09:41.155 19:16:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:41.155 19:16:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:41.155 19:16:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:41.155 19:16:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:41.155 19:16:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:41.155 19:16:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:41.155 19:16:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:41.155 19:16:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:41.155 19:16:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:41.155 19:16:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:41.155 19:16:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:41.155 19:16:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:41.155 19:16:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:41.155 19:16:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:41.155 19:16:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:41.155 19:16:27 -- nvmf/common.sh@105 -- # continue 2 00:09:41.155 19:16:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.155 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:41.155 19:16:27 -- nvmf/common.sh@105 -- # continue 2 00:09:41.155 19:16:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:41.155 19:16:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:41.155 19:16:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:41.155 19:16:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:41.155 19:16:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:41.155 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:41.155 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:09:41.155 altname enp24s0f0np0 00:09:41.155 altname ens785f0np0 00:09:41.155 inet 192.168.100.8/24 scope global mlx_0_0 00:09:41.155 valid_lft forever preferred_lft forever 00:09:41.155 19:16:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:41.155 19:16:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:41.155 19:16:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:41.155 19:16:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:41.155 19:16:27 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:41.155 19:16:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:41.155 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:41.155 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:09:41.155 altname enp24s0f1np1 00:09:41.155 altname ens785f1np1 00:09:41.155 inet 192.168.100.9/24 scope global mlx_0_1 00:09:41.155 valid_lft forever preferred_lft forever 00:09:41.155 19:16:27 -- nvmf/common.sh@411 -- # return 0 00:09:41.155 19:16:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:41.155 19:16:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:41.155 19:16:27 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:41.155 19:16:27 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:41.155 19:16:27 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:41.155 19:16:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:41.155 19:16:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:41.156 19:16:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:41.156 19:16:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:41.156 19:16:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:41.156 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.156 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:41.156 19:16:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:41.156 19:16:27 -- nvmf/common.sh@105 -- # continue 2 00:09:41.156 19:16:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:41.156 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.156 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:41.156 19:16:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:41.156 19:16:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:41.156 19:16:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:41.156 19:16:27 -- nvmf/common.sh@105 -- # continue 2 00:09:41.156 19:16:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:41.156 19:16:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:41.156 19:16:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:41.156 19:16:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:41.156 19:16:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:41.156 19:16:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:41.156 19:16:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:41.156 19:16:27 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:41.156 192.168.100.9' 00:09:41.156 19:16:27 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:41.156 192.168.100.9' 00:09:41.156 19:16:27 -- nvmf/common.sh@446 -- # head -n 1 00:09:41.156 19:16:27 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:41.156 19:16:27 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:41.156 192.168.100.9' 00:09:41.156 19:16:27 -- nvmf/common.sh@447 -- # tail -n +2 00:09:41.156 19:16:27 -- nvmf/common.sh@447 -- # head -n 1 00:09:41.156 19:16:27 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:41.156 19:16:27 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:41.156 19:16:27 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:41.156 19:16:27 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:41.156 19:16:27 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:41.156 19:16:27 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:41.156 19:16:27 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:09:41.156 19:16:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:41.156 19:16:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:41.156 19:16:27 -- common/autotest_common.sh@10 -- # set +x 00:09:41.156 19:16:27 -- nvmf/common.sh@470 -- # nvmfpid=2943219 00:09:41.156 19:16:27 -- nvmf/common.sh@471 -- # waitforlisten 2943219 00:09:41.156 19:16:27 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:41.156 19:16:27 -- common/autotest_common.sh@817 -- # '[' -z 2943219 ']' 00:09:41.156 19:16:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:41.156 19:16:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:41.156 19:16:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:41.156 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:41.156 19:16:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:41.156 19:16:27 -- common/autotest_common.sh@10 -- # set +x 00:09:41.156 [2024-04-24 19:16:27.692048] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:09:41.156 [2024-04-24 19:16:27.692108] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:41.156 EAL: No free 2048 kB hugepages reported on node 1 00:09:41.156 [2024-04-24 19:16:27.764808] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:41.156 [2024-04-24 19:16:27.850882] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:41.156 [2024-04-24 19:16:27.850920] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:41.156 [2024-04-24 19:16:27.850929] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:41.156 [2024-04-24 19:16:27.850938] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:41.156 [2024-04-24 19:16:27.850946] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:41.156 [2024-04-24 19:16:27.851052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:41.156 [2024-04-24 19:16:27.851133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:41.156 [2024-04-24 19:16:27.851135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:41.725 19:16:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:41.725 19:16:28 -- common/autotest_common.sh@850 -- # return 0 00:09:41.725 19:16:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:41.725 19:16:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.725 19:16:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:41.725 19:16:28 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:09:41.725 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.725 [2024-04-24 19:16:28.577042] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21dca30/0x21e0f20) succeed. 00:09:41.725 [2024-04-24 19:16:28.587302] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21ddfd0/0x22225b0) succeed. 00:09:41.725 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.725 19:16:28 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:09:41.725 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.725 Malloc0 00:09:41.725 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.725 19:16:28 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:09:41.725 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.725 Delay0 00:09:41.725 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.725 19:16:28 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:09:41.725 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.725 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.725 19:16:28 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:09:41.725 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.725 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.986 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.986 19:16:28 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:09:41.986 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.986 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.986 [2024-04-24 19:16:28.752080] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:41.986 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.986 19:16:28 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:09:41.986 19:16:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.986 19:16:28 -- common/autotest_common.sh@10 -- # set +x 00:09:41.986 19:16:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.986 19:16:28 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:09:41.986 EAL: No free 2048 kB hugepages reported on node 1 00:09:41.986 [2024-04-24 19:16:28.845316] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:09:44.515 Initializing NVMe Controllers 00:09:44.515 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:09:44.515 controller IO queue size 128 less than required 00:09:44.515 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:09:44.515 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:09:44.515 Initialization complete. Launching workers. 00:09:44.515 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 50681 00:09:44.515 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 50742, failed to submit 62 00:09:44.515 success 50682, unsuccess 60, failed 0 00:09:44.515 19:16:30 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:09:44.515 19:16:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:44.515 19:16:30 -- common/autotest_common.sh@10 -- # set +x 00:09:44.515 19:16:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:44.515 19:16:30 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:09:44.515 19:16:30 -- target/abort.sh@38 -- # nvmftestfini 00:09:44.515 19:16:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:44.515 19:16:30 -- nvmf/common.sh@117 -- # sync 00:09:44.515 19:16:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:44.515 19:16:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:44.515 19:16:30 -- nvmf/common.sh@120 -- # set +e 00:09:44.515 19:16:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:44.515 19:16:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:44.515 rmmod nvme_rdma 00:09:44.515 rmmod nvme_fabrics 00:09:44.515 19:16:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:44.516 19:16:31 -- nvmf/common.sh@124 -- # set -e 00:09:44.516 19:16:31 -- nvmf/common.sh@125 -- # return 0 00:09:44.516 19:16:31 -- nvmf/common.sh@478 -- # '[' -n 2943219 ']' 00:09:44.516 19:16:31 -- nvmf/common.sh@479 -- # killprocess 2943219 00:09:44.516 19:16:31 -- common/autotest_common.sh@936 -- # '[' -z 2943219 ']' 00:09:44.516 19:16:31 -- common/autotest_common.sh@940 -- # kill -0 2943219 00:09:44.516 19:16:31 -- common/autotest_common.sh@941 -- # uname 00:09:44.516 19:16:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:44.516 19:16:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2943219 00:09:44.516 19:16:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:44.516 19:16:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:44.516 19:16:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2943219' 00:09:44.516 killing process with pid 2943219 00:09:44.516 19:16:31 -- common/autotest_common.sh@955 -- # kill 2943219 00:09:44.516 19:16:31 -- common/autotest_common.sh@960 -- # wait 2943219 00:09:44.516 [2024-04-24 19:16:31.135018] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:44.516 19:16:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:44.516 19:16:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:44.516 00:09:44.516 real 0m10.074s 00:09:44.516 user 0m14.447s 00:09:44.516 sys 0m5.179s 00:09:44.516 19:16:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:44.516 19:16:31 -- common/autotest_common.sh@10 -- # set +x 00:09:44.516 ************************************ 00:09:44.516 END TEST nvmf_abort 00:09:44.516 ************************************ 00:09:44.516 19:16:31 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:09:44.516 19:16:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:44.516 19:16:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:44.516 19:16:31 -- common/autotest_common.sh@10 -- # set +x 00:09:44.775 ************************************ 00:09:44.775 START TEST nvmf_ns_hotplug_stress 00:09:44.775 ************************************ 00:09:44.775 19:16:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:09:44.775 * Looking for test storage... 00:09:44.775 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:44.775 19:16:31 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:44.775 19:16:31 -- nvmf/common.sh@7 -- # uname -s 00:09:44.775 19:16:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:44.775 19:16:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:44.775 19:16:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:44.775 19:16:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:44.775 19:16:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:44.775 19:16:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:44.775 19:16:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:44.775 19:16:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:44.775 19:16:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:44.775 19:16:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:44.775 19:16:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:09:44.775 19:16:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:09:44.775 19:16:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:44.775 19:16:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:44.775 19:16:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:44.775 19:16:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:44.775 19:16:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:44.775 19:16:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:44.775 19:16:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:44.775 19:16:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:44.775 19:16:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.775 19:16:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.775 19:16:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.775 19:16:31 -- paths/export.sh@5 -- # export PATH 00:09:44.775 19:16:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.775 19:16:31 -- nvmf/common.sh@47 -- # : 0 00:09:44.775 19:16:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:44.775 19:16:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:44.775 19:16:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:44.775 19:16:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:44.775 19:16:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:44.775 19:16:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:44.775 19:16:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:44.775 19:16:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:44.775 19:16:31 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:09:44.775 19:16:31 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:09:44.775 19:16:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:44.775 19:16:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:44.775 19:16:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:44.775 19:16:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:44.775 19:16:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:44.775 19:16:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:44.775 19:16:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:44.775 19:16:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:44.775 19:16:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:44.775 19:16:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:44.775 19:16:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:44.775 19:16:31 -- common/autotest_common.sh@10 -- # set +x 00:09:50.039 19:16:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:50.039 19:16:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:50.039 19:16:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:50.039 19:16:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:50.039 19:16:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:50.039 19:16:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:50.039 19:16:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:50.039 19:16:36 -- nvmf/common.sh@295 -- # net_devs=() 00:09:50.039 19:16:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:50.039 19:16:36 -- nvmf/common.sh@296 -- # e810=() 00:09:50.039 19:16:36 -- nvmf/common.sh@296 -- # local -ga e810 00:09:50.039 19:16:36 -- nvmf/common.sh@297 -- # x722=() 00:09:50.039 19:16:36 -- nvmf/common.sh@297 -- # local -ga x722 00:09:50.039 19:16:36 -- nvmf/common.sh@298 -- # mlx=() 00:09:50.039 19:16:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:50.039 19:16:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:50.039 19:16:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:50.039 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:50.039 19:16:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:50.039 19:16:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:50.039 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:50.039 19:16:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:50.039 19:16:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:50.039 19:16:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:50.039 19:16:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:50.039 Found net devices under 0000:18:00.0: mlx_0_0 00:09:50.039 19:16:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:50.039 19:16:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:50.039 19:16:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:50.039 Found net devices under 0000:18:00.1: mlx_0_1 00:09:50.039 19:16:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:50.039 19:16:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:50.039 19:16:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:50.039 19:16:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:50.039 19:16:36 -- nvmf/common.sh@58 -- # uname 00:09:50.039 19:16:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:50.039 19:16:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:50.039 19:16:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:50.039 19:16:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:50.039 19:16:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:50.039 19:16:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:50.039 19:16:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:50.039 19:16:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:50.039 19:16:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:50.039 19:16:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:50.039 19:16:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:50.039 19:16:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:50.039 19:16:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:50.039 19:16:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:50.039 19:16:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:50.039 19:16:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:50.039 19:16:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:50.039 19:16:36 -- nvmf/common.sh@105 -- # continue 2 00:09:50.039 19:16:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.039 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:50.039 19:16:36 -- nvmf/common.sh@105 -- # continue 2 00:09:50.039 19:16:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:50.039 19:16:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:50.039 19:16:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:50.039 19:16:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:50.039 19:16:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:50.039 19:16:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:50.039 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:50.039 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:09:50.039 altname enp24s0f0np0 00:09:50.039 altname ens785f0np0 00:09:50.039 inet 192.168.100.8/24 scope global mlx_0_0 00:09:50.039 valid_lft forever preferred_lft forever 00:09:50.039 19:16:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:50.039 19:16:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:50.039 19:16:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:50.039 19:16:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:50.040 19:16:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:50.040 19:16:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:50.040 19:16:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:50.040 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:50.040 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:09:50.040 altname enp24s0f1np1 00:09:50.040 altname ens785f1np1 00:09:50.040 inet 192.168.100.9/24 scope global mlx_0_1 00:09:50.040 valid_lft forever preferred_lft forever 00:09:50.040 19:16:36 -- nvmf/common.sh@411 -- # return 0 00:09:50.040 19:16:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:50.040 19:16:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:50.040 19:16:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:50.040 19:16:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:50.040 19:16:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:50.040 19:16:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:50.040 19:16:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:50.040 19:16:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:50.040 19:16:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:50.040 19:16:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:50.040 19:16:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:50.040 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.040 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:50.040 19:16:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:50.040 19:16:36 -- nvmf/common.sh@105 -- # continue 2 00:09:50.040 19:16:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:50.040 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.040 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:50.040 19:16:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:50.040 19:16:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:50.040 19:16:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:50.040 19:16:36 -- nvmf/common.sh@105 -- # continue 2 00:09:50.040 19:16:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:50.040 19:16:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:50.040 19:16:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:50.040 19:16:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:50.040 19:16:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:50.040 19:16:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:50.040 19:16:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:50.040 19:16:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:50.040 192.168.100.9' 00:09:50.040 19:16:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:50.040 192.168.100.9' 00:09:50.040 19:16:36 -- nvmf/common.sh@446 -- # head -n 1 00:09:50.040 19:16:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:50.040 19:16:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:50.040 192.168.100.9' 00:09:50.040 19:16:36 -- nvmf/common.sh@447 -- # tail -n +2 00:09:50.040 19:16:36 -- nvmf/common.sh@447 -- # head -n 1 00:09:50.040 19:16:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:50.040 19:16:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:50.040 19:16:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:50.040 19:16:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:50.040 19:16:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:50.040 19:16:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:50.040 19:16:36 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:09:50.040 19:16:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:50.040 19:16:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:50.040 19:16:36 -- common/autotest_common.sh@10 -- # set +x 00:09:50.040 19:16:36 -- nvmf/common.sh@470 -- # nvmfpid=2946398 00:09:50.040 19:16:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:50.040 19:16:36 -- nvmf/common.sh@471 -- # waitforlisten 2946398 00:09:50.040 19:16:36 -- common/autotest_common.sh@817 -- # '[' -z 2946398 ']' 00:09:50.040 19:16:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:50.040 19:16:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:50.040 19:16:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:50.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:50.040 19:16:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:50.040 19:16:36 -- common/autotest_common.sh@10 -- # set +x 00:09:50.040 [2024-04-24 19:16:36.960412] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:09:50.040 [2024-04-24 19:16:36.960476] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:50.040 EAL: No free 2048 kB hugepages reported on node 1 00:09:50.040 [2024-04-24 19:16:37.032757] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:50.298 [2024-04-24 19:16:37.117663] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:50.298 [2024-04-24 19:16:37.117707] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:50.298 [2024-04-24 19:16:37.117717] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:50.298 [2024-04-24 19:16:37.117726] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:50.298 [2024-04-24 19:16:37.117733] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:50.298 [2024-04-24 19:16:37.117835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:50.298 [2024-04-24 19:16:37.117911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:50.298 [2024-04-24 19:16:37.117913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:50.863 19:16:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:50.863 19:16:37 -- common/autotest_common.sh@850 -- # return 0 00:09:50.863 19:16:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:50.863 19:16:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:50.863 19:16:37 -- common/autotest_common.sh@10 -- # set +x 00:09:50.863 19:16:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:50.863 19:16:37 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:09:50.863 19:16:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:51.121 [2024-04-24 19:16:37.995401] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1efea30/0x1f02f20) succeed. 00:09:51.121 [2024-04-24 19:16:38.005718] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1efffd0/0x1f445b0) succeed. 00:09:51.121 19:16:38 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:51.379 19:16:38 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:51.638 [2024-04-24 19:16:38.497858] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:51.638 19:16:38 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:09:51.896 19:16:38 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:09:51.896 Malloc0 00:09:51.896 19:16:38 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:09:52.154 Delay0 00:09:52.154 19:16:39 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:52.412 19:16:39 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:09:52.412 NULL1 00:09:52.412 19:16:39 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:09:52.670 19:16:39 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:09:52.670 19:16:39 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=2946788 00:09:52.670 19:16:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:52.670 19:16:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:52.670 EAL: No free 2048 kB hugepages reported on node 1 00:09:54.045 Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 19:16:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:54.045 19:16:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:09:54.045 19:16:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:09:54.304 true 00:09:54.304 19:16:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:54.304 19:16:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 19:16:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:55.238 19:16:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:09:55.238 19:16:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:09:55.494 true 00:09:55.494 19:16:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:55.494 19:16:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 19:16:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:56.428 19:16:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:09:56.428 19:16:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:09:56.714 true 00:09:56.714 19:16:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:56.714 19:16:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:57.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.309 19:16:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:57.567 19:16:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:09:57.567 19:16:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:09:57.825 true 00:09:57.825 19:16:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:57.825 19:16:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:58.760 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 19:16:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:58.761 19:16:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:09:58.761 19:16:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:09:59.019 true 00:09:59.019 19:16:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:09:59.019 19:16:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:59.953 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:59.953 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:59.953 19:16:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:59.953 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:59.953 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:59.953 19:16:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:09:59.953 19:16:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:10:00.212 true 00:10:00.212 19:16:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:00.212 19:16:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:01.146 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.146 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 19:16:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:01.147 19:16:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:10:01.147 19:16:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:10:01.405 true 00:10:01.405 19:16:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:01.405 19:16:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 19:16:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.340 19:16:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:10:02.340 19:16:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:10:02.598 true 00:10:02.598 19:16:49 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:02.598 19:16:49 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 19:16:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.532 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.790 19:16:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:10:03.790 19:16:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:10:03.790 true 00:10:03.790 19:16:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:03.790 19:16:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 19:16:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.983 19:16:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:10:04.983 19:16:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:10:04.983 true 00:10:04.983 19:16:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:04.983 19:16:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.917 19:16:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.176 19:16:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:10:06.176 19:16:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:10:06.176 true 00:10:06.176 19:16:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:06.176 19:16:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:07.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.110 19:16:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:07.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:07.368 19:16:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:10:07.368 19:16:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:10:07.368 true 00:10:07.626 19:16:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:07.626 19:16:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 19:16:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.560 19:16:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:10:08.560 19:16:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:10:08.560 true 00:10:08.818 19:16:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:08.818 19:16:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:09.385 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 19:16:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.643 19:16:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:10:09.643 19:16:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:10:09.902 true 00:10:09.902 19:16:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:09.902 19:16:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.836 19:16:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.836 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.837 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.837 19:16:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:10:10.837 19:16:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:10:11.095 true 00:10:11.095 19:16:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:11.095 19:16:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 19:16:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.029 19:16:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:10:12.029 19:16:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:10:12.287 true 00:10:12.287 19:16:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:12.287 19:16:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 19:17:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.221 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.479 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:13.479 19:17:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:10:13.479 19:17:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:10:13.479 true 00:10:13.736 19:17:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:13.736 19:17:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:14.301 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.301 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.301 19:17:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.558 19:17:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:10:14.558 19:17:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:10:14.816 true 00:10:14.816 19:17:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:14.816 19:17:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 19:17:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.747 19:17:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:10:15.747 19:17:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:10:16.004 true 00:10:16.004 19:17:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:16.004 19:17:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 19:17:03 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.935 19:17:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:10:16.935 19:17:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:10:17.192 true 00:10:17.192 19:17:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:17.192 19:17:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:18.125 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.125 19:17:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:18.125 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.125 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.125 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.125 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.125 19:17:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:10:18.125 19:17:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:10:18.382 true 00:10:18.382 19:17:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:18.382 19:17:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 19:17:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.317 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.577 19:17:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:10:19.577 19:17:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:10:19.577 true 00:10:19.577 19:17:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:19.577 19:17:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 19:17:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.510 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.767 19:17:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:10:20.767 19:17:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:10:20.767 true 00:10:20.767 19:17:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:20.767 19:17:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 19:17:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.699 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.957 19:17:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:10:21.957 19:17:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:10:21.957 true 00:10:21.957 19:17:08 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:21.957 19:17:08 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:22.890 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.890 19:17:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:22.890 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.167 19:17:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:10:23.167 19:17:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:10:23.167 true 00:10:23.167 19:17:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:23.167 19:17:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:23.450 19:17:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:23.722 19:17:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:10:23.722 19:17:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:10:23.722 true 00:10:23.722 19:17:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:23.722 19:17:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:23.980 19:17:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:24.237 19:17:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:10:24.237 19:17:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:10:24.237 true 00:10:24.237 19:17:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:24.237 19:17:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:24.495 19:17:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:24.753 19:17:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:10:24.753 19:17:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:10:24.753 true 00:10:24.753 19:17:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:24.754 19:17:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:25.012 Initializing NVMe Controllers 00:10:25.012 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:25.012 Controller IO queue size 128, less than required. 00:10:25.012 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:25.012 Controller IO queue size 128, less than required. 00:10:25.012 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:25.012 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:10:25.012 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:10:25.012 Initialization complete. Launching workers. 00:10:25.012 ======================================================== 00:10:25.012 Latency(us) 00:10:25.012 Device Information : IOPS MiB/s Average min max 00:10:25.012 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6048.03 2.95 18525.93 925.74 1137587.46 00:10:25.012 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 33322.93 16.27 3841.16 1679.21 291190.41 00:10:25.012 ======================================================== 00:10:25.012 Total : 39370.97 19.22 6096.98 925.74 1137587.46 00:10:25.012 00:10:25.012 19:17:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:25.270 19:17:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:10:25.270 19:17:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:10:25.270 true 00:10:25.529 19:17:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 2946788 00:10:25.529 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (2946788) - No such process 00:10:25.529 19:17:12 -- target/ns_hotplug_stress.sh@44 -- # wait 2946788 00:10:25.529 19:17:12 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:10:25.529 19:17:12 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:10:25.529 19:17:12 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:25.529 19:17:12 -- nvmf/common.sh@117 -- # sync 00:10:25.529 19:17:12 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:25.529 19:17:12 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:25.529 19:17:12 -- nvmf/common.sh@120 -- # set +e 00:10:25.529 19:17:12 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:25.529 19:17:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:25.529 rmmod nvme_rdma 00:10:25.529 rmmod nvme_fabrics 00:10:25.529 19:17:12 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:25.529 19:17:12 -- nvmf/common.sh@124 -- # set -e 00:10:25.529 19:17:12 -- nvmf/common.sh@125 -- # return 0 00:10:25.529 19:17:12 -- nvmf/common.sh@478 -- # '[' -n 2946398 ']' 00:10:25.529 19:17:12 -- nvmf/common.sh@479 -- # killprocess 2946398 00:10:25.529 19:17:12 -- common/autotest_common.sh@936 -- # '[' -z 2946398 ']' 00:10:25.529 19:17:12 -- common/autotest_common.sh@940 -- # kill -0 2946398 00:10:25.529 19:17:12 -- common/autotest_common.sh@941 -- # uname 00:10:25.529 19:17:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:25.529 19:17:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2946398 00:10:25.529 19:17:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:10:25.529 19:17:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:10:25.529 19:17:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2946398' 00:10:25.529 killing process with pid 2946398 00:10:25.529 19:17:12 -- common/autotest_common.sh@955 -- # kill 2946398 00:10:25.529 19:17:12 -- common/autotest_common.sh@960 -- # wait 2946398 00:10:25.529 [2024-04-24 19:17:12.470334] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:25.787 19:17:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:25.787 19:17:12 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:25.787 00:10:25.787 real 0m41.176s 00:10:25.787 user 2m34.031s 00:10:25.787 sys 0m7.869s 00:10:25.787 19:17:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:25.787 19:17:12 -- common/autotest_common.sh@10 -- # set +x 00:10:25.787 ************************************ 00:10:25.787 END TEST nvmf_ns_hotplug_stress 00:10:25.787 ************************************ 00:10:25.787 19:17:12 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:10:25.787 19:17:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:25.787 19:17:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:25.787 19:17:12 -- common/autotest_common.sh@10 -- # set +x 00:10:26.046 ************************************ 00:10:26.046 START TEST nvmf_connect_stress 00:10:26.046 ************************************ 00:10:26.046 19:17:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:10:26.046 * Looking for test storage... 00:10:26.046 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:26.046 19:17:12 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:26.046 19:17:12 -- nvmf/common.sh@7 -- # uname -s 00:10:26.046 19:17:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:26.046 19:17:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:26.046 19:17:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:26.046 19:17:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:26.046 19:17:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:26.046 19:17:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:26.046 19:17:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:26.046 19:17:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:26.046 19:17:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:26.046 19:17:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:26.046 19:17:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:10:26.046 19:17:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:10:26.046 19:17:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:26.046 19:17:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:26.046 19:17:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:26.046 19:17:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:26.046 19:17:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:26.046 19:17:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:26.046 19:17:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:26.046 19:17:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:26.046 19:17:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.046 19:17:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.046 19:17:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.046 19:17:12 -- paths/export.sh@5 -- # export PATH 00:10:26.046 19:17:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.046 19:17:12 -- nvmf/common.sh@47 -- # : 0 00:10:26.046 19:17:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:26.046 19:17:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:26.046 19:17:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:26.046 19:17:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:26.046 19:17:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:26.046 19:17:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:26.046 19:17:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:26.046 19:17:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:26.046 19:17:12 -- target/connect_stress.sh@12 -- # nvmftestinit 00:10:26.046 19:17:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:26.046 19:17:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:26.046 19:17:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:26.046 19:17:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:26.046 19:17:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:26.046 19:17:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:26.046 19:17:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:26.046 19:17:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:26.046 19:17:13 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:26.046 19:17:13 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:26.046 19:17:13 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:26.046 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:10:32.606 19:17:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:32.606 19:17:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:32.606 19:17:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:32.606 19:17:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:32.606 19:17:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:32.606 19:17:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:32.606 19:17:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:32.606 19:17:19 -- nvmf/common.sh@295 -- # net_devs=() 00:10:32.606 19:17:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:32.606 19:17:19 -- nvmf/common.sh@296 -- # e810=() 00:10:32.606 19:17:19 -- nvmf/common.sh@296 -- # local -ga e810 00:10:32.606 19:17:19 -- nvmf/common.sh@297 -- # x722=() 00:10:32.606 19:17:19 -- nvmf/common.sh@297 -- # local -ga x722 00:10:32.606 19:17:19 -- nvmf/common.sh@298 -- # mlx=() 00:10:32.606 19:17:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:32.606 19:17:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:32.606 19:17:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:32.606 19:17:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:32.606 19:17:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:32.606 19:17:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:32.606 19:17:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:32.606 19:17:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:32.606 19:17:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:32.606 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:32.606 19:17:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:32.606 19:17:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:32.606 19:17:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:32.606 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:32.606 19:17:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:32.606 19:17:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:32.607 19:17:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:32.607 19:17:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:32.607 19:17:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:32.607 Found net devices under 0000:18:00.0: mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:32.607 19:17:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:32.607 19:17:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:32.607 19:17:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:32.607 Found net devices under 0000:18:00.1: mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:32.607 19:17:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:32.607 19:17:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:32.607 19:17:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:32.607 19:17:19 -- nvmf/common.sh@58 -- # uname 00:10:32.607 19:17:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:32.607 19:17:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:32.607 19:17:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:32.607 19:17:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:32.607 19:17:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:32.607 19:17:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:32.607 19:17:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:32.607 19:17:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:32.607 19:17:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:32.607 19:17:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:32.607 19:17:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:32.607 19:17:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:32.607 19:17:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:32.607 19:17:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:32.607 19:17:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:32.607 19:17:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@105 -- # continue 2 00:10:32.607 19:17:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@105 -- # continue 2 00:10:32.607 19:17:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:32.607 19:17:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.607 19:17:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:32.607 19:17:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:32.607 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:32.607 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:10:32.607 altname enp24s0f0np0 00:10:32.607 altname ens785f0np0 00:10:32.607 inet 192.168.100.8/24 scope global mlx_0_0 00:10:32.607 valid_lft forever preferred_lft forever 00:10:32.607 19:17:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:32.607 19:17:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.607 19:17:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:32.607 19:17:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:32.607 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:32.607 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:10:32.607 altname enp24s0f1np1 00:10:32.607 altname ens785f1np1 00:10:32.607 inet 192.168.100.9/24 scope global mlx_0_1 00:10:32.607 valid_lft forever preferred_lft forever 00:10:32.607 19:17:19 -- nvmf/common.sh@411 -- # return 0 00:10:32.607 19:17:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:32.607 19:17:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:32.607 19:17:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:32.607 19:17:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:32.607 19:17:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:32.607 19:17:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:32.607 19:17:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:32.607 19:17:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:32.607 19:17:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:32.607 19:17:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@105 -- # continue 2 00:10:32.607 19:17:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.607 19:17:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:32.607 19:17:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@105 -- # continue 2 00:10:32.607 19:17:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:32.607 19:17:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.607 19:17:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:32.607 19:17:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.607 19:17:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.607 19:17:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:32.607 192.168.100.9' 00:10:32.607 19:17:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:32.607 192.168.100.9' 00:10:32.607 19:17:19 -- nvmf/common.sh@446 -- # head -n 1 00:10:32.607 19:17:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:32.607 19:17:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:32.607 192.168.100.9' 00:10:32.607 19:17:19 -- nvmf/common.sh@447 -- # head -n 1 00:10:32.607 19:17:19 -- nvmf/common.sh@447 -- # tail -n +2 00:10:32.607 19:17:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:32.607 19:17:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:32.607 19:17:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:32.607 19:17:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:32.607 19:17:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:32.607 19:17:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:32.607 19:17:19 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:10:32.607 19:17:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:32.607 19:17:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:32.607 19:17:19 -- common/autotest_common.sh@10 -- # set +x 00:10:32.607 19:17:19 -- nvmf/common.sh@470 -- # nvmfpid=2954233 00:10:32.607 19:17:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:32.607 19:17:19 -- nvmf/common.sh@471 -- # waitforlisten 2954233 00:10:32.607 19:17:19 -- common/autotest_common.sh@817 -- # '[' -z 2954233 ']' 00:10:32.607 19:17:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:32.607 19:17:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:32.607 19:17:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:32.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:32.607 19:17:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:32.607 19:17:19 -- common/autotest_common.sh@10 -- # set +x 00:10:32.607 [2024-04-24 19:17:19.420274] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:10:32.607 [2024-04-24 19:17:19.420346] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:32.607 EAL: No free 2048 kB hugepages reported on node 1 00:10:32.607 [2024-04-24 19:17:19.493350] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:32.607 [2024-04-24 19:17:19.579398] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:32.607 [2024-04-24 19:17:19.579445] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:32.608 [2024-04-24 19:17:19.579454] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:32.608 [2024-04-24 19:17:19.579464] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:32.608 [2024-04-24 19:17:19.579471] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:32.608 [2024-04-24 19:17:19.579595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:32.608 [2024-04-24 19:17:19.579667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:32.608 [2024-04-24 19:17:19.579669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:33.543 19:17:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:33.543 19:17:20 -- common/autotest_common.sh@850 -- # return 0 00:10:33.543 19:17:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:33.543 19:17:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:33.543 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:33.543 19:17:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:33.543 19:17:20 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:33.543 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.543 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:33.543 [2024-04-24 19:17:20.308820] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x6ffa30/0x703f20) succeed. 00:10:33.543 [2024-04-24 19:17:20.319041] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x700fd0/0x7455b0) succeed. 00:10:33.543 19:17:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:33.543 19:17:20 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:33.543 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.543 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:33.543 19:17:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:33.543 19:17:20 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:33.543 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.543 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:33.543 [2024-04-24 19:17:20.445922] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:33.543 19:17:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:33.543 19:17:20 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:33.543 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.543 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:33.543 NULL1 00:10:33.543 19:17:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:33.543 19:17:20 -- target/connect_stress.sh@21 -- # PERF_PID=2954326 00:10:33.543 19:17:20 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:33.543 19:17:20 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:10:33.543 19:17:20 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # seq 1 20 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 EAL: No free 2048 kB hugepages reported on node 1 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.543 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.543 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.801 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.801 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.801 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.801 19:17:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:33.801 19:17:20 -- target/connect_stress.sh@28 -- # cat 00:10:33.801 19:17:20 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:33.801 19:17:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:33.801 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.801 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:34.059 19:17:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:34.059 19:17:20 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:34.059 19:17:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:34.059 19:17:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:34.059 19:17:20 -- common/autotest_common.sh@10 -- # set +x 00:10:34.317 19:17:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:34.317 19:17:21 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:34.318 19:17:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:34.318 19:17:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:34.318 19:17:21 -- common/autotest_common.sh@10 -- # set +x 00:10:34.575 19:17:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:34.575 19:17:21 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:34.575 19:17:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:34.575 19:17:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:34.575 19:17:21 -- common/autotest_common.sh@10 -- # set +x 00:10:35.142 19:17:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:35.142 19:17:21 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:35.142 19:17:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:35.142 19:17:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:35.142 19:17:21 -- common/autotest_common.sh@10 -- # set +x 00:10:35.400 19:17:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:35.400 19:17:22 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:35.400 19:17:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:35.400 19:17:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:35.400 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:10:35.659 19:17:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:35.659 19:17:22 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:35.659 19:17:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:35.659 19:17:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:35.659 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:10:35.917 19:17:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:35.917 19:17:22 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:35.917 19:17:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:35.917 19:17:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:35.917 19:17:22 -- common/autotest_common.sh@10 -- # set +x 00:10:36.174 19:17:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:36.174 19:17:23 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:36.174 19:17:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:36.174 19:17:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:36.174 19:17:23 -- common/autotest_common.sh@10 -- # set +x 00:10:36.741 19:17:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:36.741 19:17:23 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:36.741 19:17:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:36.741 19:17:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:36.741 19:17:23 -- common/autotest_common.sh@10 -- # set +x 00:10:36.998 19:17:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:36.998 19:17:23 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:36.998 19:17:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:36.998 19:17:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:36.998 19:17:23 -- common/autotest_common.sh@10 -- # set +x 00:10:37.256 19:17:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:37.256 19:17:24 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:37.256 19:17:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:37.256 19:17:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:37.256 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:10:37.514 19:17:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:37.514 19:17:24 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:37.514 19:17:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:37.514 19:17:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:37.514 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:10:38.080 19:17:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:38.080 19:17:24 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:38.080 19:17:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:38.080 19:17:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:38.080 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:10:38.338 19:17:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:38.338 19:17:25 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:38.338 19:17:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:38.338 19:17:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:38.338 19:17:25 -- common/autotest_common.sh@10 -- # set +x 00:10:38.596 19:17:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:38.596 19:17:25 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:38.596 19:17:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:38.596 19:17:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:38.596 19:17:25 -- common/autotest_common.sh@10 -- # set +x 00:10:38.854 19:17:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:38.854 19:17:25 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:38.854 19:17:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:38.854 19:17:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:38.854 19:17:25 -- common/autotest_common.sh@10 -- # set +x 00:10:39.113 19:17:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:39.113 19:17:26 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:39.113 19:17:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:39.113 19:17:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:39.113 19:17:26 -- common/autotest_common.sh@10 -- # set +x 00:10:39.679 19:17:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:39.679 19:17:26 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:39.679 19:17:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:39.679 19:17:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:39.679 19:17:26 -- common/autotest_common.sh@10 -- # set +x 00:10:39.937 19:17:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:39.937 19:17:26 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:39.937 19:17:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:39.937 19:17:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:39.937 19:17:26 -- common/autotest_common.sh@10 -- # set +x 00:10:40.196 19:17:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:40.196 19:17:27 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:40.196 19:17:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:40.196 19:17:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:40.196 19:17:27 -- common/autotest_common.sh@10 -- # set +x 00:10:40.454 19:17:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:40.454 19:17:27 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:40.454 19:17:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:40.454 19:17:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:40.454 19:17:27 -- common/autotest_common.sh@10 -- # set +x 00:10:41.019 19:17:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.019 19:17:27 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:41.019 19:17:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.019 19:17:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.019 19:17:27 -- common/autotest_common.sh@10 -- # set +x 00:10:41.277 19:17:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.277 19:17:28 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:41.277 19:17:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.277 19:17:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.277 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:10:41.534 19:17:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.534 19:17:28 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:41.534 19:17:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.534 19:17:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.534 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:10:41.792 19:17:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.792 19:17:28 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:41.792 19:17:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.792 19:17:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.792 19:17:28 -- common/autotest_common.sh@10 -- # set +x 00:10:42.050 19:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.050 19:17:29 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:42.050 19:17:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:42.050 19:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.050 19:17:29 -- common/autotest_common.sh@10 -- # set +x 00:10:42.617 19:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.617 19:17:29 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:42.617 19:17:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:42.618 19:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.618 19:17:29 -- common/autotest_common.sh@10 -- # set +x 00:10:42.876 19:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.876 19:17:29 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:42.876 19:17:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:42.876 19:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.876 19:17:29 -- common/autotest_common.sh@10 -- # set +x 00:10:43.134 19:17:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:43.134 19:17:30 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:43.134 19:17:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.134 19:17:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:43.134 19:17:30 -- common/autotest_common.sh@10 -- # set +x 00:10:43.392 19:17:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:43.392 19:17:30 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:43.392 19:17:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.392 19:17:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:43.392 19:17:30 -- common/autotest_common.sh@10 -- # set +x 00:10:43.649 19:17:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:43.649 19:17:30 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:43.649 19:17:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.649 19:17:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:43.649 19:17:30 -- common/autotest_common.sh@10 -- # set +x 00:10:43.907 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:44.165 19:17:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:44.165 19:17:30 -- target/connect_stress.sh@34 -- # kill -0 2954326 00:10:44.165 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2954326) - No such process 00:10:44.165 19:17:30 -- target/connect_stress.sh@38 -- # wait 2954326 00:10:44.165 19:17:30 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:44.165 19:17:30 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:10:44.165 19:17:30 -- target/connect_stress.sh@43 -- # nvmftestfini 00:10:44.165 19:17:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:44.165 19:17:30 -- nvmf/common.sh@117 -- # sync 00:10:44.165 19:17:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:44.165 19:17:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:44.165 19:17:30 -- nvmf/common.sh@120 -- # set +e 00:10:44.165 19:17:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:44.165 19:17:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:44.165 rmmod nvme_rdma 00:10:44.165 rmmod nvme_fabrics 00:10:44.165 19:17:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:44.165 19:17:31 -- nvmf/common.sh@124 -- # set -e 00:10:44.165 19:17:31 -- nvmf/common.sh@125 -- # return 0 00:10:44.165 19:17:31 -- nvmf/common.sh@478 -- # '[' -n 2954233 ']' 00:10:44.165 19:17:31 -- nvmf/common.sh@479 -- # killprocess 2954233 00:10:44.165 19:17:31 -- common/autotest_common.sh@936 -- # '[' -z 2954233 ']' 00:10:44.165 19:17:31 -- common/autotest_common.sh@940 -- # kill -0 2954233 00:10:44.165 19:17:31 -- common/autotest_common.sh@941 -- # uname 00:10:44.165 19:17:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:44.165 19:17:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2954233 00:10:44.165 19:17:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:10:44.165 19:17:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:10:44.165 19:17:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2954233' 00:10:44.165 killing process with pid 2954233 00:10:44.165 19:17:31 -- common/autotest_common.sh@955 -- # kill 2954233 00:10:44.165 19:17:31 -- common/autotest_common.sh@960 -- # wait 2954233 00:10:44.165 [2024-04-24 19:17:31.155840] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:44.423 19:17:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:44.423 19:17:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:44.423 00:10:44.423 real 0m18.507s 00:10:44.423 user 0m42.519s 00:10:44.423 sys 0m7.541s 00:10:44.423 19:17:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:44.423 19:17:31 -- common/autotest_common.sh@10 -- # set +x 00:10:44.423 ************************************ 00:10:44.423 END TEST nvmf_connect_stress 00:10:44.423 ************************************ 00:10:44.423 19:17:31 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:10:44.423 19:17:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:44.423 19:17:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:44.423 19:17:31 -- common/autotest_common.sh@10 -- # set +x 00:10:44.682 ************************************ 00:10:44.682 START TEST nvmf_fused_ordering 00:10:44.682 ************************************ 00:10:44.682 19:17:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:10:44.682 * Looking for test storage... 00:10:44.682 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:44.682 19:17:31 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:44.682 19:17:31 -- nvmf/common.sh@7 -- # uname -s 00:10:44.682 19:17:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:44.682 19:17:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:44.682 19:17:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:44.682 19:17:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:44.682 19:17:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:44.682 19:17:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:44.682 19:17:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:44.682 19:17:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:44.682 19:17:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:44.682 19:17:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:44.940 19:17:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:10:44.940 19:17:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:10:44.940 19:17:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:44.940 19:17:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:44.940 19:17:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:44.940 19:17:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:44.940 19:17:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:44.940 19:17:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:44.940 19:17:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:44.940 19:17:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:44.940 19:17:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.940 19:17:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.940 19:17:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.940 19:17:31 -- paths/export.sh@5 -- # export PATH 00:10:44.940 19:17:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.940 19:17:31 -- nvmf/common.sh@47 -- # : 0 00:10:44.940 19:17:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:44.940 19:17:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:44.940 19:17:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:44.940 19:17:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:44.940 19:17:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:44.940 19:17:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:44.940 19:17:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:44.940 19:17:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:44.940 19:17:31 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:10:44.940 19:17:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:44.940 19:17:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:44.940 19:17:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:44.940 19:17:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:44.940 19:17:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:44.940 19:17:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:44.940 19:17:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:44.940 19:17:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:44.940 19:17:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:44.940 19:17:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:44.940 19:17:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:44.941 19:17:31 -- common/autotest_common.sh@10 -- # set +x 00:10:50.205 19:17:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:50.205 19:17:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:50.205 19:17:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:50.205 19:17:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:50.205 19:17:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:50.205 19:17:36 -- nvmf/common.sh@295 -- # net_devs=() 00:10:50.205 19:17:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@296 -- # e810=() 00:10:50.205 19:17:36 -- nvmf/common.sh@296 -- # local -ga e810 00:10:50.205 19:17:36 -- nvmf/common.sh@297 -- # x722=() 00:10:50.205 19:17:36 -- nvmf/common.sh@297 -- # local -ga x722 00:10:50.205 19:17:36 -- nvmf/common.sh@298 -- # mlx=() 00:10:50.205 19:17:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:50.205 19:17:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:50.205 19:17:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:50.205 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:50.205 19:17:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:50.205 19:17:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:50.205 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:50.205 19:17:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:50.205 19:17:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:50.205 19:17:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:50.205 19:17:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:50.205 Found net devices under 0000:18:00.0: mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:50.205 19:17:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:50.205 19:17:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:50.205 Found net devices under 0000:18:00.1: mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:50.205 19:17:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:50.205 19:17:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:50.205 19:17:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:50.205 19:17:36 -- nvmf/common.sh@58 -- # uname 00:10:50.205 19:17:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:50.205 19:17:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:50.205 19:17:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:50.205 19:17:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:50.205 19:17:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:50.205 19:17:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:50.205 19:17:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:50.205 19:17:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:50.205 19:17:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:50.205 19:17:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:50.205 19:17:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:50.205 19:17:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:50.205 19:17:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:50.205 19:17:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@105 -- # continue 2 00:10:50.205 19:17:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@105 -- # continue 2 00:10:50.205 19:17:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:50.205 19:17:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:50.205 19:17:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:50.205 19:17:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:50.205 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:50.205 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:10:50.205 altname enp24s0f0np0 00:10:50.205 altname ens785f0np0 00:10:50.205 inet 192.168.100.8/24 scope global mlx_0_0 00:10:50.205 valid_lft forever preferred_lft forever 00:10:50.205 19:17:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:50.205 19:17:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:50.205 19:17:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:50.205 19:17:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:50.205 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:50.205 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:10:50.205 altname enp24s0f1np1 00:10:50.205 altname ens785f1np1 00:10:50.205 inet 192.168.100.9/24 scope global mlx_0_1 00:10:50.205 valid_lft forever preferred_lft forever 00:10:50.205 19:17:36 -- nvmf/common.sh@411 -- # return 0 00:10:50.205 19:17:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:50.205 19:17:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:50.205 19:17:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:50.205 19:17:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:50.205 19:17:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:50.205 19:17:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:50.205 19:17:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:50.205 19:17:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:50.205 19:17:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@105 -- # continue 2 00:10:50.205 19:17:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:50.205 19:17:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:50.205 19:17:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@105 -- # continue 2 00:10:50.205 19:17:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:50.205 19:17:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:50.205 19:17:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:50.205 19:17:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:50.205 19:17:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:50.205 19:17:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:50.205 192.168.100.9' 00:10:50.205 19:17:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:50.205 192.168.100.9' 00:10:50.205 19:17:37 -- nvmf/common.sh@446 -- # head -n 1 00:10:50.205 19:17:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:50.205 19:17:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:50.205 192.168.100.9' 00:10:50.205 19:17:37 -- nvmf/common.sh@447 -- # tail -n +2 00:10:50.205 19:17:37 -- nvmf/common.sh@447 -- # head -n 1 00:10:50.205 19:17:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:50.205 19:17:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:50.205 19:17:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:50.205 19:17:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:50.205 19:17:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:50.205 19:17:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:50.205 19:17:37 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:10:50.205 19:17:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:50.205 19:17:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:50.205 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:10:50.205 19:17:37 -- nvmf/common.sh@470 -- # nvmfpid=2958526 00:10:50.205 19:17:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:10:50.205 19:17:37 -- nvmf/common.sh@471 -- # waitforlisten 2958526 00:10:50.206 19:17:37 -- common/autotest_common.sh@817 -- # '[' -z 2958526 ']' 00:10:50.206 19:17:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:50.206 19:17:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:50.206 19:17:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:50.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:50.206 19:17:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:50.206 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:10:50.206 [2024-04-24 19:17:37.109228] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:10:50.206 [2024-04-24 19:17:37.109290] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:50.206 EAL: No free 2048 kB hugepages reported on node 1 00:10:50.206 [2024-04-24 19:17:37.177654] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:50.463 [2024-04-24 19:17:37.265464] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:50.463 [2024-04-24 19:17:37.265507] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:50.463 [2024-04-24 19:17:37.265517] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:50.463 [2024-04-24 19:17:37.265541] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:50.463 [2024-04-24 19:17:37.265548] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:50.463 [2024-04-24 19:17:37.265582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:51.030 19:17:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:51.030 19:17:37 -- common/autotest_common.sh@850 -- # return 0 00:10:51.030 19:17:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:51.030 19:17:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:51.030 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:10:51.030 19:17:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:51.030 19:17:37 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:51.030 19:17:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.030 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:10:51.030 [2024-04-24 19:17:37.987538] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc713e0/0xc758d0) succeed. 00:10:51.030 [2024-04-24 19:17:37.996283] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc728e0/0xcb6f60) succeed. 00:10:51.030 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.030 19:17:38 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:51.030 19:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.030 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:10:51.288 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.288 19:17:38 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:51.288 19:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.288 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:10:51.288 [2024-04-24 19:17:38.059015] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:51.288 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.288 19:17:38 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:51.288 19:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.288 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:10:51.288 NULL1 00:10:51.288 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.288 19:17:38 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:10:51.288 19:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.288 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:10:51.288 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.288 19:17:38 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:10:51.288 19:17:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:51.288 19:17:38 -- common/autotest_common.sh@10 -- # set +x 00:10:51.288 19:17:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:51.288 19:17:38 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:10:51.288 [2024-04-24 19:17:38.117759] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:10:51.288 [2024-04-24 19:17:38.117794] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2958724 ] 00:10:51.288 EAL: No free 2048 kB hugepages reported on node 1 00:10:51.288 Attached to nqn.2016-06.io.spdk:cnode1 00:10:51.288 Namespace ID: 1 size: 1GB 00:10:51.288 fused_ordering(0) 00:10:51.288 fused_ordering(1) 00:10:51.288 fused_ordering(2) 00:10:51.288 fused_ordering(3) 00:10:51.288 fused_ordering(4) 00:10:51.288 fused_ordering(5) 00:10:51.288 fused_ordering(6) 00:10:51.288 fused_ordering(7) 00:10:51.288 fused_ordering(8) 00:10:51.288 fused_ordering(9) 00:10:51.288 fused_ordering(10) 00:10:51.288 fused_ordering(11) 00:10:51.288 fused_ordering(12) 00:10:51.288 fused_ordering(13) 00:10:51.288 fused_ordering(14) 00:10:51.288 fused_ordering(15) 00:10:51.288 fused_ordering(16) 00:10:51.288 fused_ordering(17) 00:10:51.288 fused_ordering(18) 00:10:51.288 fused_ordering(19) 00:10:51.288 fused_ordering(20) 00:10:51.288 fused_ordering(21) 00:10:51.288 fused_ordering(22) 00:10:51.288 fused_ordering(23) 00:10:51.288 fused_ordering(24) 00:10:51.288 fused_ordering(25) 00:10:51.288 fused_ordering(26) 00:10:51.288 fused_ordering(27) 00:10:51.288 fused_ordering(28) 00:10:51.288 fused_ordering(29) 00:10:51.288 fused_ordering(30) 00:10:51.288 fused_ordering(31) 00:10:51.288 fused_ordering(32) 00:10:51.288 fused_ordering(33) 00:10:51.288 fused_ordering(34) 00:10:51.288 fused_ordering(35) 00:10:51.288 fused_ordering(36) 00:10:51.288 fused_ordering(37) 00:10:51.288 fused_ordering(38) 00:10:51.288 fused_ordering(39) 00:10:51.288 fused_ordering(40) 00:10:51.288 fused_ordering(41) 00:10:51.288 fused_ordering(42) 00:10:51.288 fused_ordering(43) 00:10:51.288 fused_ordering(44) 00:10:51.288 fused_ordering(45) 00:10:51.288 fused_ordering(46) 00:10:51.288 fused_ordering(47) 00:10:51.288 fused_ordering(48) 00:10:51.288 fused_ordering(49) 00:10:51.288 fused_ordering(50) 00:10:51.288 fused_ordering(51) 00:10:51.288 fused_ordering(52) 00:10:51.288 fused_ordering(53) 00:10:51.288 fused_ordering(54) 00:10:51.288 fused_ordering(55) 00:10:51.288 fused_ordering(56) 00:10:51.288 fused_ordering(57) 00:10:51.288 fused_ordering(58) 00:10:51.288 fused_ordering(59) 00:10:51.288 fused_ordering(60) 00:10:51.288 fused_ordering(61) 00:10:51.288 fused_ordering(62) 00:10:51.288 fused_ordering(63) 00:10:51.288 fused_ordering(64) 00:10:51.288 fused_ordering(65) 00:10:51.288 fused_ordering(66) 00:10:51.288 fused_ordering(67) 00:10:51.288 fused_ordering(68) 00:10:51.288 fused_ordering(69) 00:10:51.288 fused_ordering(70) 00:10:51.288 fused_ordering(71) 00:10:51.288 fused_ordering(72) 00:10:51.288 fused_ordering(73) 00:10:51.288 fused_ordering(74) 00:10:51.288 fused_ordering(75) 00:10:51.288 fused_ordering(76) 00:10:51.288 fused_ordering(77) 00:10:51.288 fused_ordering(78) 00:10:51.288 fused_ordering(79) 00:10:51.288 fused_ordering(80) 00:10:51.288 fused_ordering(81) 00:10:51.288 fused_ordering(82) 00:10:51.288 fused_ordering(83) 00:10:51.288 fused_ordering(84) 00:10:51.288 fused_ordering(85) 00:10:51.288 fused_ordering(86) 00:10:51.288 fused_ordering(87) 00:10:51.288 fused_ordering(88) 00:10:51.288 fused_ordering(89) 00:10:51.288 fused_ordering(90) 00:10:51.288 fused_ordering(91) 00:10:51.288 fused_ordering(92) 00:10:51.288 fused_ordering(93) 00:10:51.288 fused_ordering(94) 00:10:51.288 fused_ordering(95) 00:10:51.288 fused_ordering(96) 00:10:51.288 fused_ordering(97) 00:10:51.288 fused_ordering(98) 00:10:51.288 fused_ordering(99) 00:10:51.288 fused_ordering(100) 00:10:51.288 fused_ordering(101) 00:10:51.288 fused_ordering(102) 00:10:51.288 fused_ordering(103) 00:10:51.288 fused_ordering(104) 00:10:51.288 fused_ordering(105) 00:10:51.288 fused_ordering(106) 00:10:51.288 fused_ordering(107) 00:10:51.288 fused_ordering(108) 00:10:51.288 fused_ordering(109) 00:10:51.288 fused_ordering(110) 00:10:51.288 fused_ordering(111) 00:10:51.288 fused_ordering(112) 00:10:51.288 fused_ordering(113) 00:10:51.288 fused_ordering(114) 00:10:51.288 fused_ordering(115) 00:10:51.288 fused_ordering(116) 00:10:51.288 fused_ordering(117) 00:10:51.288 fused_ordering(118) 00:10:51.288 fused_ordering(119) 00:10:51.288 fused_ordering(120) 00:10:51.288 fused_ordering(121) 00:10:51.288 fused_ordering(122) 00:10:51.288 fused_ordering(123) 00:10:51.288 fused_ordering(124) 00:10:51.288 fused_ordering(125) 00:10:51.288 fused_ordering(126) 00:10:51.288 fused_ordering(127) 00:10:51.288 fused_ordering(128) 00:10:51.288 fused_ordering(129) 00:10:51.288 fused_ordering(130) 00:10:51.288 fused_ordering(131) 00:10:51.288 fused_ordering(132) 00:10:51.288 fused_ordering(133) 00:10:51.288 fused_ordering(134) 00:10:51.288 fused_ordering(135) 00:10:51.288 fused_ordering(136) 00:10:51.288 fused_ordering(137) 00:10:51.288 fused_ordering(138) 00:10:51.288 fused_ordering(139) 00:10:51.288 fused_ordering(140) 00:10:51.288 fused_ordering(141) 00:10:51.288 fused_ordering(142) 00:10:51.288 fused_ordering(143) 00:10:51.288 fused_ordering(144) 00:10:51.288 fused_ordering(145) 00:10:51.288 fused_ordering(146) 00:10:51.288 fused_ordering(147) 00:10:51.288 fused_ordering(148) 00:10:51.288 fused_ordering(149) 00:10:51.289 fused_ordering(150) 00:10:51.289 fused_ordering(151) 00:10:51.289 fused_ordering(152) 00:10:51.289 fused_ordering(153) 00:10:51.289 fused_ordering(154) 00:10:51.289 fused_ordering(155) 00:10:51.289 fused_ordering(156) 00:10:51.289 fused_ordering(157) 00:10:51.289 fused_ordering(158) 00:10:51.289 fused_ordering(159) 00:10:51.289 fused_ordering(160) 00:10:51.289 fused_ordering(161) 00:10:51.289 fused_ordering(162) 00:10:51.289 fused_ordering(163) 00:10:51.289 fused_ordering(164) 00:10:51.289 fused_ordering(165) 00:10:51.289 fused_ordering(166) 00:10:51.289 fused_ordering(167) 00:10:51.289 fused_ordering(168) 00:10:51.289 fused_ordering(169) 00:10:51.289 fused_ordering(170) 00:10:51.289 fused_ordering(171) 00:10:51.289 fused_ordering(172) 00:10:51.289 fused_ordering(173) 00:10:51.289 fused_ordering(174) 00:10:51.289 fused_ordering(175) 00:10:51.289 fused_ordering(176) 00:10:51.289 fused_ordering(177) 00:10:51.289 fused_ordering(178) 00:10:51.289 fused_ordering(179) 00:10:51.289 fused_ordering(180) 00:10:51.289 fused_ordering(181) 00:10:51.289 fused_ordering(182) 00:10:51.289 fused_ordering(183) 00:10:51.289 fused_ordering(184) 00:10:51.289 fused_ordering(185) 00:10:51.289 fused_ordering(186) 00:10:51.289 fused_ordering(187) 00:10:51.289 fused_ordering(188) 00:10:51.289 fused_ordering(189) 00:10:51.289 fused_ordering(190) 00:10:51.289 fused_ordering(191) 00:10:51.289 fused_ordering(192) 00:10:51.289 fused_ordering(193) 00:10:51.289 fused_ordering(194) 00:10:51.289 fused_ordering(195) 00:10:51.289 fused_ordering(196) 00:10:51.289 fused_ordering(197) 00:10:51.289 fused_ordering(198) 00:10:51.289 fused_ordering(199) 00:10:51.289 fused_ordering(200) 00:10:51.289 fused_ordering(201) 00:10:51.289 fused_ordering(202) 00:10:51.289 fused_ordering(203) 00:10:51.289 fused_ordering(204) 00:10:51.289 fused_ordering(205) 00:10:51.549 fused_ordering(206) 00:10:51.549 fused_ordering(207) 00:10:51.549 fused_ordering(208) 00:10:51.549 fused_ordering(209) 00:10:51.549 fused_ordering(210) 00:10:51.549 fused_ordering(211) 00:10:51.549 fused_ordering(212) 00:10:51.549 fused_ordering(213) 00:10:51.549 fused_ordering(214) 00:10:51.549 fused_ordering(215) 00:10:51.549 fused_ordering(216) 00:10:51.549 fused_ordering(217) 00:10:51.549 fused_ordering(218) 00:10:51.549 fused_ordering(219) 00:10:51.549 fused_ordering(220) 00:10:51.549 fused_ordering(221) 00:10:51.549 fused_ordering(222) 00:10:51.549 fused_ordering(223) 00:10:51.549 fused_ordering(224) 00:10:51.549 fused_ordering(225) 00:10:51.549 fused_ordering(226) 00:10:51.549 fused_ordering(227) 00:10:51.549 fused_ordering(228) 00:10:51.549 fused_ordering(229) 00:10:51.549 fused_ordering(230) 00:10:51.549 fused_ordering(231) 00:10:51.549 fused_ordering(232) 00:10:51.549 fused_ordering(233) 00:10:51.549 fused_ordering(234) 00:10:51.549 fused_ordering(235) 00:10:51.549 fused_ordering(236) 00:10:51.549 fused_ordering(237) 00:10:51.549 fused_ordering(238) 00:10:51.549 fused_ordering(239) 00:10:51.549 fused_ordering(240) 00:10:51.549 fused_ordering(241) 00:10:51.549 fused_ordering(242) 00:10:51.549 fused_ordering(243) 00:10:51.549 fused_ordering(244) 00:10:51.549 fused_ordering(245) 00:10:51.549 fused_ordering(246) 00:10:51.549 fused_ordering(247) 00:10:51.549 fused_ordering(248) 00:10:51.549 fused_ordering(249) 00:10:51.549 fused_ordering(250) 00:10:51.549 fused_ordering(251) 00:10:51.549 fused_ordering(252) 00:10:51.549 fused_ordering(253) 00:10:51.549 fused_ordering(254) 00:10:51.549 fused_ordering(255) 00:10:51.549 fused_ordering(256) 00:10:51.549 fused_ordering(257) 00:10:51.549 fused_ordering(258) 00:10:51.549 fused_ordering(259) 00:10:51.549 fused_ordering(260) 00:10:51.549 fused_ordering(261) 00:10:51.549 fused_ordering(262) 00:10:51.549 fused_ordering(263) 00:10:51.549 fused_ordering(264) 00:10:51.549 fused_ordering(265) 00:10:51.549 fused_ordering(266) 00:10:51.549 fused_ordering(267) 00:10:51.549 fused_ordering(268) 00:10:51.549 fused_ordering(269) 00:10:51.549 fused_ordering(270) 00:10:51.549 fused_ordering(271) 00:10:51.549 fused_ordering(272) 00:10:51.549 fused_ordering(273) 00:10:51.549 fused_ordering(274) 00:10:51.549 fused_ordering(275) 00:10:51.549 fused_ordering(276) 00:10:51.549 fused_ordering(277) 00:10:51.549 fused_ordering(278) 00:10:51.549 fused_ordering(279) 00:10:51.549 fused_ordering(280) 00:10:51.549 fused_ordering(281) 00:10:51.549 fused_ordering(282) 00:10:51.549 fused_ordering(283) 00:10:51.549 fused_ordering(284) 00:10:51.549 fused_ordering(285) 00:10:51.549 fused_ordering(286) 00:10:51.549 fused_ordering(287) 00:10:51.549 fused_ordering(288) 00:10:51.549 fused_ordering(289) 00:10:51.549 fused_ordering(290) 00:10:51.549 fused_ordering(291) 00:10:51.549 fused_ordering(292) 00:10:51.549 fused_ordering(293) 00:10:51.549 fused_ordering(294) 00:10:51.549 fused_ordering(295) 00:10:51.549 fused_ordering(296) 00:10:51.549 fused_ordering(297) 00:10:51.549 fused_ordering(298) 00:10:51.549 fused_ordering(299) 00:10:51.549 fused_ordering(300) 00:10:51.549 fused_ordering(301) 00:10:51.549 fused_ordering(302) 00:10:51.549 fused_ordering(303) 00:10:51.549 fused_ordering(304) 00:10:51.549 fused_ordering(305) 00:10:51.549 fused_ordering(306) 00:10:51.549 fused_ordering(307) 00:10:51.549 fused_ordering(308) 00:10:51.549 fused_ordering(309) 00:10:51.549 fused_ordering(310) 00:10:51.549 fused_ordering(311) 00:10:51.549 fused_ordering(312) 00:10:51.549 fused_ordering(313) 00:10:51.549 fused_ordering(314) 00:10:51.549 fused_ordering(315) 00:10:51.549 fused_ordering(316) 00:10:51.549 fused_ordering(317) 00:10:51.549 fused_ordering(318) 00:10:51.549 fused_ordering(319) 00:10:51.549 fused_ordering(320) 00:10:51.549 fused_ordering(321) 00:10:51.549 fused_ordering(322) 00:10:51.549 fused_ordering(323) 00:10:51.549 fused_ordering(324) 00:10:51.549 fused_ordering(325) 00:10:51.549 fused_ordering(326) 00:10:51.549 fused_ordering(327) 00:10:51.549 fused_ordering(328) 00:10:51.549 fused_ordering(329) 00:10:51.549 fused_ordering(330) 00:10:51.549 fused_ordering(331) 00:10:51.549 fused_ordering(332) 00:10:51.549 fused_ordering(333) 00:10:51.549 fused_ordering(334) 00:10:51.549 fused_ordering(335) 00:10:51.550 fused_ordering(336) 00:10:51.550 fused_ordering(337) 00:10:51.550 fused_ordering(338) 00:10:51.550 fused_ordering(339) 00:10:51.550 fused_ordering(340) 00:10:51.550 fused_ordering(341) 00:10:51.550 fused_ordering(342) 00:10:51.550 fused_ordering(343) 00:10:51.550 fused_ordering(344) 00:10:51.550 fused_ordering(345) 00:10:51.550 fused_ordering(346) 00:10:51.550 fused_ordering(347) 00:10:51.550 fused_ordering(348) 00:10:51.550 fused_ordering(349) 00:10:51.550 fused_ordering(350) 00:10:51.550 fused_ordering(351) 00:10:51.550 fused_ordering(352) 00:10:51.550 fused_ordering(353) 00:10:51.550 fused_ordering(354) 00:10:51.550 fused_ordering(355) 00:10:51.550 fused_ordering(356) 00:10:51.550 fused_ordering(357) 00:10:51.550 fused_ordering(358) 00:10:51.550 fused_ordering(359) 00:10:51.550 fused_ordering(360) 00:10:51.550 fused_ordering(361) 00:10:51.550 fused_ordering(362) 00:10:51.550 fused_ordering(363) 00:10:51.550 fused_ordering(364) 00:10:51.550 fused_ordering(365) 00:10:51.550 fused_ordering(366) 00:10:51.550 fused_ordering(367) 00:10:51.550 fused_ordering(368) 00:10:51.550 fused_ordering(369) 00:10:51.550 fused_ordering(370) 00:10:51.550 fused_ordering(371) 00:10:51.550 fused_ordering(372) 00:10:51.550 fused_ordering(373) 00:10:51.550 fused_ordering(374) 00:10:51.550 fused_ordering(375) 00:10:51.550 fused_ordering(376) 00:10:51.550 fused_ordering(377) 00:10:51.550 fused_ordering(378) 00:10:51.550 fused_ordering(379) 00:10:51.550 fused_ordering(380) 00:10:51.550 fused_ordering(381) 00:10:51.550 fused_ordering(382) 00:10:51.550 fused_ordering(383) 00:10:51.550 fused_ordering(384) 00:10:51.550 fused_ordering(385) 00:10:51.550 fused_ordering(386) 00:10:51.550 fused_ordering(387) 00:10:51.550 fused_ordering(388) 00:10:51.550 fused_ordering(389) 00:10:51.550 fused_ordering(390) 00:10:51.550 fused_ordering(391) 00:10:51.550 fused_ordering(392) 00:10:51.550 fused_ordering(393) 00:10:51.550 fused_ordering(394) 00:10:51.550 fused_ordering(395) 00:10:51.550 fused_ordering(396) 00:10:51.550 fused_ordering(397) 00:10:51.550 fused_ordering(398) 00:10:51.550 fused_ordering(399) 00:10:51.550 fused_ordering(400) 00:10:51.550 fused_ordering(401) 00:10:51.550 fused_ordering(402) 00:10:51.550 fused_ordering(403) 00:10:51.550 fused_ordering(404) 00:10:51.550 fused_ordering(405) 00:10:51.550 fused_ordering(406) 00:10:51.550 fused_ordering(407) 00:10:51.550 fused_ordering(408) 00:10:51.550 fused_ordering(409) 00:10:51.550 fused_ordering(410) 00:10:51.550 fused_ordering(411) 00:10:51.550 fused_ordering(412) 00:10:51.550 fused_ordering(413) 00:10:51.550 fused_ordering(414) 00:10:51.550 fused_ordering(415) 00:10:51.550 fused_ordering(416) 00:10:51.550 fused_ordering(417) 00:10:51.550 fused_ordering(418) 00:10:51.550 fused_ordering(419) 00:10:51.550 fused_ordering(420) 00:10:51.550 fused_ordering(421) 00:10:51.550 fused_ordering(422) 00:10:51.550 fused_ordering(423) 00:10:51.550 fused_ordering(424) 00:10:51.550 fused_ordering(425) 00:10:51.550 fused_ordering(426) 00:10:51.550 fused_ordering(427) 00:10:51.550 fused_ordering(428) 00:10:51.550 fused_ordering(429) 00:10:51.550 fused_ordering(430) 00:10:51.550 fused_ordering(431) 00:10:51.550 fused_ordering(432) 00:10:51.550 fused_ordering(433) 00:10:51.550 fused_ordering(434) 00:10:51.550 fused_ordering(435) 00:10:51.550 fused_ordering(436) 00:10:51.550 fused_ordering(437) 00:10:51.550 fused_ordering(438) 00:10:51.550 fused_ordering(439) 00:10:51.550 fused_ordering(440) 00:10:51.550 fused_ordering(441) 00:10:51.550 fused_ordering(442) 00:10:51.550 fused_ordering(443) 00:10:51.550 fused_ordering(444) 00:10:51.550 fused_ordering(445) 00:10:51.550 fused_ordering(446) 00:10:51.550 fused_ordering(447) 00:10:51.550 fused_ordering(448) 00:10:51.550 fused_ordering(449) 00:10:51.550 fused_ordering(450) 00:10:51.550 fused_ordering(451) 00:10:51.550 fused_ordering(452) 00:10:51.550 fused_ordering(453) 00:10:51.550 fused_ordering(454) 00:10:51.550 fused_ordering(455) 00:10:51.550 fused_ordering(456) 00:10:51.550 fused_ordering(457) 00:10:51.550 fused_ordering(458) 00:10:51.550 fused_ordering(459) 00:10:51.550 fused_ordering(460) 00:10:51.550 fused_ordering(461) 00:10:51.550 fused_ordering(462) 00:10:51.550 fused_ordering(463) 00:10:51.550 fused_ordering(464) 00:10:51.550 fused_ordering(465) 00:10:51.550 fused_ordering(466) 00:10:51.550 fused_ordering(467) 00:10:51.550 fused_ordering(468) 00:10:51.550 fused_ordering(469) 00:10:51.550 fused_ordering(470) 00:10:51.550 fused_ordering(471) 00:10:51.550 fused_ordering(472) 00:10:51.550 fused_ordering(473) 00:10:51.550 fused_ordering(474) 00:10:51.550 fused_ordering(475) 00:10:51.550 fused_ordering(476) 00:10:51.550 fused_ordering(477) 00:10:51.550 fused_ordering(478) 00:10:51.550 fused_ordering(479) 00:10:51.550 fused_ordering(480) 00:10:51.550 fused_ordering(481) 00:10:51.550 fused_ordering(482) 00:10:51.550 fused_ordering(483) 00:10:51.550 fused_ordering(484) 00:10:51.550 fused_ordering(485) 00:10:51.550 fused_ordering(486) 00:10:51.550 fused_ordering(487) 00:10:51.550 fused_ordering(488) 00:10:51.550 fused_ordering(489) 00:10:51.550 fused_ordering(490) 00:10:51.550 fused_ordering(491) 00:10:51.550 fused_ordering(492) 00:10:51.550 fused_ordering(493) 00:10:51.550 fused_ordering(494) 00:10:51.550 fused_ordering(495) 00:10:51.550 fused_ordering(496) 00:10:51.550 fused_ordering(497) 00:10:51.550 fused_ordering(498) 00:10:51.550 fused_ordering(499) 00:10:51.550 fused_ordering(500) 00:10:51.550 fused_ordering(501) 00:10:51.550 fused_ordering(502) 00:10:51.550 fused_ordering(503) 00:10:51.550 fused_ordering(504) 00:10:51.550 fused_ordering(505) 00:10:51.550 fused_ordering(506) 00:10:51.550 fused_ordering(507) 00:10:51.550 fused_ordering(508) 00:10:51.550 fused_ordering(509) 00:10:51.550 fused_ordering(510) 00:10:51.550 fused_ordering(511) 00:10:51.550 fused_ordering(512) 00:10:51.550 fused_ordering(513) 00:10:51.550 fused_ordering(514) 00:10:51.550 fused_ordering(515) 00:10:51.550 fused_ordering(516) 00:10:51.550 fused_ordering(517) 00:10:51.550 fused_ordering(518) 00:10:51.550 fused_ordering(519) 00:10:51.550 fused_ordering(520) 00:10:51.550 fused_ordering(521) 00:10:51.550 fused_ordering(522) 00:10:51.550 fused_ordering(523) 00:10:51.550 fused_ordering(524) 00:10:51.550 fused_ordering(525) 00:10:51.550 fused_ordering(526) 00:10:51.550 fused_ordering(527) 00:10:51.550 fused_ordering(528) 00:10:51.550 fused_ordering(529) 00:10:51.550 fused_ordering(530) 00:10:51.550 fused_ordering(531) 00:10:51.550 fused_ordering(532) 00:10:51.550 fused_ordering(533) 00:10:51.550 fused_ordering(534) 00:10:51.550 fused_ordering(535) 00:10:51.550 fused_ordering(536) 00:10:51.550 fused_ordering(537) 00:10:51.550 fused_ordering(538) 00:10:51.550 fused_ordering(539) 00:10:51.550 fused_ordering(540) 00:10:51.550 fused_ordering(541) 00:10:51.550 fused_ordering(542) 00:10:51.550 fused_ordering(543) 00:10:51.550 fused_ordering(544) 00:10:51.550 fused_ordering(545) 00:10:51.550 fused_ordering(546) 00:10:51.550 fused_ordering(547) 00:10:51.550 fused_ordering(548) 00:10:51.550 fused_ordering(549) 00:10:51.550 fused_ordering(550) 00:10:51.550 fused_ordering(551) 00:10:51.550 fused_ordering(552) 00:10:51.550 fused_ordering(553) 00:10:51.550 fused_ordering(554) 00:10:51.550 fused_ordering(555) 00:10:51.550 fused_ordering(556) 00:10:51.550 fused_ordering(557) 00:10:51.550 fused_ordering(558) 00:10:51.550 fused_ordering(559) 00:10:51.550 fused_ordering(560) 00:10:51.550 fused_ordering(561) 00:10:51.550 fused_ordering(562) 00:10:51.550 fused_ordering(563) 00:10:51.550 fused_ordering(564) 00:10:51.550 fused_ordering(565) 00:10:51.550 fused_ordering(566) 00:10:51.550 fused_ordering(567) 00:10:51.550 fused_ordering(568) 00:10:51.550 fused_ordering(569) 00:10:51.550 fused_ordering(570) 00:10:51.550 fused_ordering(571) 00:10:51.550 fused_ordering(572) 00:10:51.550 fused_ordering(573) 00:10:51.550 fused_ordering(574) 00:10:51.550 fused_ordering(575) 00:10:51.550 fused_ordering(576) 00:10:51.550 fused_ordering(577) 00:10:51.550 fused_ordering(578) 00:10:51.550 fused_ordering(579) 00:10:51.550 fused_ordering(580) 00:10:51.550 fused_ordering(581) 00:10:51.550 fused_ordering(582) 00:10:51.550 fused_ordering(583) 00:10:51.550 fused_ordering(584) 00:10:51.550 fused_ordering(585) 00:10:51.550 fused_ordering(586) 00:10:51.550 fused_ordering(587) 00:10:51.550 fused_ordering(588) 00:10:51.550 fused_ordering(589) 00:10:51.550 fused_ordering(590) 00:10:51.550 fused_ordering(591) 00:10:51.550 fused_ordering(592) 00:10:51.550 fused_ordering(593) 00:10:51.550 fused_ordering(594) 00:10:51.550 fused_ordering(595) 00:10:51.550 fused_ordering(596) 00:10:51.550 fused_ordering(597) 00:10:51.550 fused_ordering(598) 00:10:51.550 fused_ordering(599) 00:10:51.550 fused_ordering(600) 00:10:51.550 fused_ordering(601) 00:10:51.551 fused_ordering(602) 00:10:51.551 fused_ordering(603) 00:10:51.551 fused_ordering(604) 00:10:51.551 fused_ordering(605) 00:10:51.551 fused_ordering(606) 00:10:51.551 fused_ordering(607) 00:10:51.551 fused_ordering(608) 00:10:51.551 fused_ordering(609) 00:10:51.551 fused_ordering(610) 00:10:51.551 fused_ordering(611) 00:10:51.551 fused_ordering(612) 00:10:51.551 fused_ordering(613) 00:10:51.551 fused_ordering(614) 00:10:51.551 fused_ordering(615) 00:10:51.809 fused_ordering(616) 00:10:51.809 fused_ordering(617) 00:10:51.809 fused_ordering(618) 00:10:51.809 fused_ordering(619) 00:10:51.809 fused_ordering(620) 00:10:51.809 fused_ordering(621) 00:10:51.809 fused_ordering(622) 00:10:51.809 fused_ordering(623) 00:10:51.809 fused_ordering(624) 00:10:51.809 fused_ordering(625) 00:10:51.809 fused_ordering(626) 00:10:51.809 fused_ordering(627) 00:10:51.809 fused_ordering(628) 00:10:51.809 fused_ordering(629) 00:10:51.809 fused_ordering(630) 00:10:51.809 fused_ordering(631) 00:10:51.809 fused_ordering(632) 00:10:51.809 fused_ordering(633) 00:10:51.809 fused_ordering(634) 00:10:51.809 fused_ordering(635) 00:10:51.809 fused_ordering(636) 00:10:51.809 fused_ordering(637) 00:10:51.809 fused_ordering(638) 00:10:51.809 fused_ordering(639) 00:10:51.809 fused_ordering(640) 00:10:51.809 fused_ordering(641) 00:10:51.809 fused_ordering(642) 00:10:51.809 fused_ordering(643) 00:10:51.809 fused_ordering(644) 00:10:51.809 fused_ordering(645) 00:10:51.809 fused_ordering(646) 00:10:51.809 fused_ordering(647) 00:10:51.809 fused_ordering(648) 00:10:51.809 fused_ordering(649) 00:10:51.809 fused_ordering(650) 00:10:51.809 fused_ordering(651) 00:10:51.809 fused_ordering(652) 00:10:51.809 fused_ordering(653) 00:10:51.809 fused_ordering(654) 00:10:51.809 fused_ordering(655) 00:10:51.809 fused_ordering(656) 00:10:51.809 fused_ordering(657) 00:10:51.809 fused_ordering(658) 00:10:51.809 fused_ordering(659) 00:10:51.809 fused_ordering(660) 00:10:51.809 fused_ordering(661) 00:10:51.809 fused_ordering(662) 00:10:51.809 fused_ordering(663) 00:10:51.809 fused_ordering(664) 00:10:51.809 fused_ordering(665) 00:10:51.809 fused_ordering(666) 00:10:51.809 fused_ordering(667) 00:10:51.809 fused_ordering(668) 00:10:51.809 fused_ordering(669) 00:10:51.809 fused_ordering(670) 00:10:51.809 fused_ordering(671) 00:10:51.809 fused_ordering(672) 00:10:51.809 fused_ordering(673) 00:10:51.809 fused_ordering(674) 00:10:51.809 fused_ordering(675) 00:10:51.809 fused_ordering(676) 00:10:51.809 fused_ordering(677) 00:10:51.809 fused_ordering(678) 00:10:51.809 fused_ordering(679) 00:10:51.809 fused_ordering(680) 00:10:51.809 fused_ordering(681) 00:10:51.809 fused_ordering(682) 00:10:51.809 fused_ordering(683) 00:10:51.809 fused_ordering(684) 00:10:51.809 fused_ordering(685) 00:10:51.809 fused_ordering(686) 00:10:51.809 fused_ordering(687) 00:10:51.809 fused_ordering(688) 00:10:51.809 fused_ordering(689) 00:10:51.809 fused_ordering(690) 00:10:51.809 fused_ordering(691) 00:10:51.809 fused_ordering(692) 00:10:51.809 fused_ordering(693) 00:10:51.809 fused_ordering(694) 00:10:51.809 fused_ordering(695) 00:10:51.809 fused_ordering(696) 00:10:51.809 fused_ordering(697) 00:10:51.809 fused_ordering(698) 00:10:51.809 fused_ordering(699) 00:10:51.809 fused_ordering(700) 00:10:51.809 fused_ordering(701) 00:10:51.809 fused_ordering(702) 00:10:51.809 fused_ordering(703) 00:10:51.809 fused_ordering(704) 00:10:51.809 fused_ordering(705) 00:10:51.809 fused_ordering(706) 00:10:51.809 fused_ordering(707) 00:10:51.809 fused_ordering(708) 00:10:51.809 fused_ordering(709) 00:10:51.809 fused_ordering(710) 00:10:51.809 fused_ordering(711) 00:10:51.809 fused_ordering(712) 00:10:51.809 fused_ordering(713) 00:10:51.809 fused_ordering(714) 00:10:51.809 fused_ordering(715) 00:10:51.809 fused_ordering(716) 00:10:51.809 fused_ordering(717) 00:10:51.809 fused_ordering(718) 00:10:51.809 fused_ordering(719) 00:10:51.809 fused_ordering(720) 00:10:51.809 fused_ordering(721) 00:10:51.809 fused_ordering(722) 00:10:51.809 fused_ordering(723) 00:10:51.809 fused_ordering(724) 00:10:51.809 fused_ordering(725) 00:10:51.809 fused_ordering(726) 00:10:51.809 fused_ordering(727) 00:10:51.809 fused_ordering(728) 00:10:51.809 fused_ordering(729) 00:10:51.809 fused_ordering(730) 00:10:51.809 fused_ordering(731) 00:10:51.809 fused_ordering(732) 00:10:51.809 fused_ordering(733) 00:10:51.809 fused_ordering(734) 00:10:51.809 fused_ordering(735) 00:10:51.809 fused_ordering(736) 00:10:51.809 fused_ordering(737) 00:10:51.809 fused_ordering(738) 00:10:51.809 fused_ordering(739) 00:10:51.809 fused_ordering(740) 00:10:51.809 fused_ordering(741) 00:10:51.809 fused_ordering(742) 00:10:51.809 fused_ordering(743) 00:10:51.809 fused_ordering(744) 00:10:51.809 fused_ordering(745) 00:10:51.809 fused_ordering(746) 00:10:51.809 fused_ordering(747) 00:10:51.809 fused_ordering(748) 00:10:51.809 fused_ordering(749) 00:10:51.809 fused_ordering(750) 00:10:51.809 fused_ordering(751) 00:10:51.809 fused_ordering(752) 00:10:51.809 fused_ordering(753) 00:10:51.809 fused_ordering(754) 00:10:51.809 fused_ordering(755) 00:10:51.809 fused_ordering(756) 00:10:51.809 fused_ordering(757) 00:10:51.809 fused_ordering(758) 00:10:51.809 fused_ordering(759) 00:10:51.810 fused_ordering(760) 00:10:51.810 fused_ordering(761) 00:10:51.810 fused_ordering(762) 00:10:51.810 fused_ordering(763) 00:10:51.810 fused_ordering(764) 00:10:51.810 fused_ordering(765) 00:10:51.810 fused_ordering(766) 00:10:51.810 fused_ordering(767) 00:10:51.810 fused_ordering(768) 00:10:51.810 fused_ordering(769) 00:10:51.810 fused_ordering(770) 00:10:51.810 fused_ordering(771) 00:10:51.810 fused_ordering(772) 00:10:51.810 fused_ordering(773) 00:10:51.810 fused_ordering(774) 00:10:51.810 fused_ordering(775) 00:10:51.810 fused_ordering(776) 00:10:51.810 fused_ordering(777) 00:10:51.810 fused_ordering(778) 00:10:51.810 fused_ordering(779) 00:10:51.810 fused_ordering(780) 00:10:51.810 fused_ordering(781) 00:10:51.810 fused_ordering(782) 00:10:51.810 fused_ordering(783) 00:10:51.810 fused_ordering(784) 00:10:51.810 fused_ordering(785) 00:10:51.810 fused_ordering(786) 00:10:51.810 fused_ordering(787) 00:10:51.810 fused_ordering(788) 00:10:51.810 fused_ordering(789) 00:10:51.810 fused_ordering(790) 00:10:51.810 fused_ordering(791) 00:10:51.810 fused_ordering(792) 00:10:51.810 fused_ordering(793) 00:10:51.810 fused_ordering(794) 00:10:51.810 fused_ordering(795) 00:10:51.810 fused_ordering(796) 00:10:51.810 fused_ordering(797) 00:10:51.810 fused_ordering(798) 00:10:51.810 fused_ordering(799) 00:10:51.810 fused_ordering(800) 00:10:51.810 fused_ordering(801) 00:10:51.810 fused_ordering(802) 00:10:51.810 fused_ordering(803) 00:10:51.810 fused_ordering(804) 00:10:51.810 fused_ordering(805) 00:10:51.810 fused_ordering(806) 00:10:51.810 fused_ordering(807) 00:10:51.810 fused_ordering(808) 00:10:51.810 fused_ordering(809) 00:10:51.810 fused_ordering(810) 00:10:51.810 fused_ordering(811) 00:10:51.810 fused_ordering(812) 00:10:51.810 fused_ordering(813) 00:10:51.810 fused_ordering(814) 00:10:51.810 fused_ordering(815) 00:10:51.810 fused_ordering(816) 00:10:51.810 fused_ordering(817) 00:10:51.810 fused_ordering(818) 00:10:51.810 fused_ordering(819) 00:10:51.810 fused_ordering(820) 00:10:51.810 fused_ordering(821) 00:10:51.810 fused_ordering(822) 00:10:51.810 fused_ordering(823) 00:10:51.810 fused_ordering(824) 00:10:51.810 fused_ordering(825) 00:10:51.810 fused_ordering(826) 00:10:51.810 fused_ordering(827) 00:10:51.810 fused_ordering(828) 00:10:51.810 fused_ordering(829) 00:10:51.810 fused_ordering(830) 00:10:51.810 fused_ordering(831) 00:10:51.810 fused_ordering(832) 00:10:51.810 fused_ordering(833) 00:10:51.810 fused_ordering(834) 00:10:51.810 fused_ordering(835) 00:10:51.810 fused_ordering(836) 00:10:51.810 fused_ordering(837) 00:10:51.810 fused_ordering(838) 00:10:51.810 fused_ordering(839) 00:10:51.810 fused_ordering(840) 00:10:51.810 fused_ordering(841) 00:10:51.810 fused_ordering(842) 00:10:51.810 fused_ordering(843) 00:10:51.810 fused_ordering(844) 00:10:51.810 fused_ordering(845) 00:10:51.810 fused_ordering(846) 00:10:51.810 fused_ordering(847) 00:10:51.810 fused_ordering(848) 00:10:51.810 fused_ordering(849) 00:10:51.810 fused_ordering(850) 00:10:51.810 fused_ordering(851) 00:10:51.810 fused_ordering(852) 00:10:51.810 fused_ordering(853) 00:10:51.810 fused_ordering(854) 00:10:51.810 fused_ordering(855) 00:10:51.810 fused_ordering(856) 00:10:51.810 fused_ordering(857) 00:10:51.810 fused_ordering(858) 00:10:51.810 fused_ordering(859) 00:10:51.810 fused_ordering(860) 00:10:51.810 fused_ordering(861) 00:10:51.810 fused_ordering(862) 00:10:51.810 fused_ordering(863) 00:10:51.810 fused_ordering(864) 00:10:51.810 fused_ordering(865) 00:10:51.810 fused_ordering(866) 00:10:51.810 fused_ordering(867) 00:10:51.810 fused_ordering(868) 00:10:51.810 fused_ordering(869) 00:10:51.810 fused_ordering(870) 00:10:51.810 fused_ordering(871) 00:10:51.810 fused_ordering(872) 00:10:51.810 fused_ordering(873) 00:10:51.810 fused_ordering(874) 00:10:51.810 fused_ordering(875) 00:10:51.810 fused_ordering(876) 00:10:51.810 fused_ordering(877) 00:10:51.810 fused_ordering(878) 00:10:51.810 fused_ordering(879) 00:10:51.810 fused_ordering(880) 00:10:51.810 fused_ordering(881) 00:10:51.810 fused_ordering(882) 00:10:51.810 fused_ordering(883) 00:10:51.810 fused_ordering(884) 00:10:51.810 fused_ordering(885) 00:10:51.810 fused_ordering(886) 00:10:51.810 fused_ordering(887) 00:10:51.810 fused_ordering(888) 00:10:51.810 fused_ordering(889) 00:10:51.810 fused_ordering(890) 00:10:51.810 fused_ordering(891) 00:10:51.810 fused_ordering(892) 00:10:51.810 fused_ordering(893) 00:10:51.810 fused_ordering(894) 00:10:51.810 fused_ordering(895) 00:10:51.810 fused_ordering(896) 00:10:51.810 fused_ordering(897) 00:10:51.810 fused_ordering(898) 00:10:51.810 fused_ordering(899) 00:10:51.810 fused_ordering(900) 00:10:51.810 fused_ordering(901) 00:10:51.810 fused_ordering(902) 00:10:51.810 fused_ordering(903) 00:10:51.810 fused_ordering(904) 00:10:51.810 fused_ordering(905) 00:10:51.810 fused_ordering(906) 00:10:51.810 fused_ordering(907) 00:10:51.810 fused_ordering(908) 00:10:51.810 fused_ordering(909) 00:10:51.810 fused_ordering(910) 00:10:51.810 fused_ordering(911) 00:10:51.810 fused_ordering(912) 00:10:51.810 fused_ordering(913) 00:10:51.810 fused_ordering(914) 00:10:51.810 fused_ordering(915) 00:10:51.810 fused_ordering(916) 00:10:51.810 fused_ordering(917) 00:10:51.810 fused_ordering(918) 00:10:51.810 fused_ordering(919) 00:10:51.810 fused_ordering(920) 00:10:51.810 fused_ordering(921) 00:10:51.810 fused_ordering(922) 00:10:51.810 fused_ordering(923) 00:10:51.810 fused_ordering(924) 00:10:51.810 fused_ordering(925) 00:10:51.810 fused_ordering(926) 00:10:51.810 fused_ordering(927) 00:10:51.810 fused_ordering(928) 00:10:51.810 fused_ordering(929) 00:10:51.810 fused_ordering(930) 00:10:51.810 fused_ordering(931) 00:10:51.810 fused_ordering(932) 00:10:51.810 fused_ordering(933) 00:10:51.810 fused_ordering(934) 00:10:51.810 fused_ordering(935) 00:10:51.810 fused_ordering(936) 00:10:51.810 fused_ordering(937) 00:10:51.810 fused_ordering(938) 00:10:51.810 fused_ordering(939) 00:10:51.810 fused_ordering(940) 00:10:51.810 fused_ordering(941) 00:10:51.810 fused_ordering(942) 00:10:51.810 fused_ordering(943) 00:10:51.810 fused_ordering(944) 00:10:51.810 fused_ordering(945) 00:10:51.810 fused_ordering(946) 00:10:51.810 fused_ordering(947) 00:10:51.810 fused_ordering(948) 00:10:51.810 fused_ordering(949) 00:10:51.810 fused_ordering(950) 00:10:51.810 fused_ordering(951) 00:10:51.810 fused_ordering(952) 00:10:51.810 fused_ordering(953) 00:10:51.810 fused_ordering(954) 00:10:51.810 fused_ordering(955) 00:10:51.810 fused_ordering(956) 00:10:51.810 fused_ordering(957) 00:10:51.810 fused_ordering(958) 00:10:51.810 fused_ordering(959) 00:10:51.810 fused_ordering(960) 00:10:51.810 fused_ordering(961) 00:10:51.810 fused_ordering(962) 00:10:51.810 fused_ordering(963) 00:10:51.810 fused_ordering(964) 00:10:51.810 fused_ordering(965) 00:10:51.810 fused_ordering(966) 00:10:51.810 fused_ordering(967) 00:10:51.810 fused_ordering(968) 00:10:51.810 fused_ordering(969) 00:10:51.810 fused_ordering(970) 00:10:51.810 fused_ordering(971) 00:10:51.810 fused_ordering(972) 00:10:51.810 fused_ordering(973) 00:10:51.810 fused_ordering(974) 00:10:51.810 fused_ordering(975) 00:10:51.810 fused_ordering(976) 00:10:51.810 fused_ordering(977) 00:10:51.810 fused_ordering(978) 00:10:51.810 fused_ordering(979) 00:10:51.810 fused_ordering(980) 00:10:51.810 fused_ordering(981) 00:10:51.810 fused_ordering(982) 00:10:51.810 fused_ordering(983) 00:10:51.810 fused_ordering(984) 00:10:51.810 fused_ordering(985) 00:10:51.810 fused_ordering(986) 00:10:51.810 fused_ordering(987) 00:10:51.810 fused_ordering(988) 00:10:51.810 fused_ordering(989) 00:10:51.810 fused_ordering(990) 00:10:51.810 fused_ordering(991) 00:10:51.810 fused_ordering(992) 00:10:51.810 fused_ordering(993) 00:10:51.810 fused_ordering(994) 00:10:51.810 fused_ordering(995) 00:10:51.810 fused_ordering(996) 00:10:51.810 fused_ordering(997) 00:10:51.810 fused_ordering(998) 00:10:51.810 fused_ordering(999) 00:10:51.810 fused_ordering(1000) 00:10:51.810 fused_ordering(1001) 00:10:51.810 fused_ordering(1002) 00:10:51.810 fused_ordering(1003) 00:10:51.810 fused_ordering(1004) 00:10:51.810 fused_ordering(1005) 00:10:51.810 fused_ordering(1006) 00:10:51.810 fused_ordering(1007) 00:10:51.810 fused_ordering(1008) 00:10:51.810 fused_ordering(1009) 00:10:51.810 fused_ordering(1010) 00:10:51.810 fused_ordering(1011) 00:10:51.810 fused_ordering(1012) 00:10:51.810 fused_ordering(1013) 00:10:51.810 fused_ordering(1014) 00:10:51.810 fused_ordering(1015) 00:10:51.810 fused_ordering(1016) 00:10:51.810 fused_ordering(1017) 00:10:51.810 fused_ordering(1018) 00:10:51.810 fused_ordering(1019) 00:10:51.810 fused_ordering(1020) 00:10:51.810 fused_ordering(1021) 00:10:51.810 fused_ordering(1022) 00:10:51.810 fused_ordering(1023) 00:10:51.810 19:17:38 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:10:51.810 19:17:38 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:10:51.810 19:17:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:51.810 19:17:38 -- nvmf/common.sh@117 -- # sync 00:10:51.811 19:17:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:51.811 19:17:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:51.811 19:17:38 -- nvmf/common.sh@120 -- # set +e 00:10:51.811 19:17:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:51.811 19:17:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:51.811 rmmod nvme_rdma 00:10:51.811 rmmod nvme_fabrics 00:10:52.069 19:17:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:52.069 19:17:38 -- nvmf/common.sh@124 -- # set -e 00:10:52.069 19:17:38 -- nvmf/common.sh@125 -- # return 0 00:10:52.069 19:17:38 -- nvmf/common.sh@478 -- # '[' -n 2958526 ']' 00:10:52.069 19:17:38 -- nvmf/common.sh@479 -- # killprocess 2958526 00:10:52.069 19:17:38 -- common/autotest_common.sh@936 -- # '[' -z 2958526 ']' 00:10:52.069 19:17:38 -- common/autotest_common.sh@940 -- # kill -0 2958526 00:10:52.069 19:17:38 -- common/autotest_common.sh@941 -- # uname 00:10:52.069 19:17:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:52.069 19:17:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2958526 00:10:52.069 19:17:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:10:52.069 19:17:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:10:52.069 19:17:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2958526' 00:10:52.069 killing process with pid 2958526 00:10:52.069 19:17:38 -- common/autotest_common.sh@955 -- # kill 2958526 00:10:52.069 19:17:38 -- common/autotest_common.sh@960 -- # wait 2958526 00:10:52.069 [2024-04-24 19:17:38.951224] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:52.327 19:17:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:52.327 19:17:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:52.327 00:10:52.328 real 0m7.588s 00:10:52.328 user 0m4.298s 00:10:52.328 sys 0m4.537s 00:10:52.328 19:17:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:52.328 19:17:39 -- common/autotest_common.sh@10 -- # set +x 00:10:52.328 ************************************ 00:10:52.328 END TEST nvmf_fused_ordering 00:10:52.328 ************************************ 00:10:52.328 19:17:39 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:10:52.328 19:17:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:52.328 19:17:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:52.328 19:17:39 -- common/autotest_common.sh@10 -- # set +x 00:10:52.328 ************************************ 00:10:52.328 START TEST nvmf_delete_subsystem 00:10:52.328 ************************************ 00:10:52.328 19:17:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:10:52.586 * Looking for test storage... 00:10:52.586 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:52.586 19:17:39 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:52.586 19:17:39 -- nvmf/common.sh@7 -- # uname -s 00:10:52.586 19:17:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:52.586 19:17:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:52.586 19:17:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:52.586 19:17:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:52.586 19:17:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:52.586 19:17:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:52.586 19:17:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:52.586 19:17:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:52.586 19:17:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:52.586 19:17:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:52.586 19:17:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:10:52.586 19:17:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:10:52.586 19:17:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:52.586 19:17:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:52.587 19:17:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:52.587 19:17:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:52.587 19:17:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:52.587 19:17:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:52.587 19:17:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:52.587 19:17:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:52.587 19:17:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.587 19:17:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.587 19:17:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.587 19:17:39 -- paths/export.sh@5 -- # export PATH 00:10:52.587 19:17:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.587 19:17:39 -- nvmf/common.sh@47 -- # : 0 00:10:52.587 19:17:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:52.587 19:17:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:52.587 19:17:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:52.587 19:17:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:52.587 19:17:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:52.587 19:17:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:52.587 19:17:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:52.587 19:17:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:52.587 19:17:39 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:10:52.587 19:17:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:52.587 19:17:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:52.587 19:17:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:52.587 19:17:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:52.587 19:17:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:52.587 19:17:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:52.587 19:17:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:52.587 19:17:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:52.587 19:17:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:52.587 19:17:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:52.587 19:17:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:52.587 19:17:39 -- common/autotest_common.sh@10 -- # set +x 00:10:59.207 19:17:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:59.207 19:17:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:59.207 19:17:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:59.207 19:17:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:59.207 19:17:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:59.207 19:17:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:59.207 19:17:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:59.207 19:17:45 -- nvmf/common.sh@295 -- # net_devs=() 00:10:59.207 19:17:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:59.207 19:17:45 -- nvmf/common.sh@296 -- # e810=() 00:10:59.207 19:17:45 -- nvmf/common.sh@296 -- # local -ga e810 00:10:59.207 19:17:45 -- nvmf/common.sh@297 -- # x722=() 00:10:59.207 19:17:45 -- nvmf/common.sh@297 -- # local -ga x722 00:10:59.207 19:17:45 -- nvmf/common.sh@298 -- # mlx=() 00:10:59.207 19:17:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:59.207 19:17:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:59.207 19:17:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:59.207 19:17:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.207 19:17:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:59.207 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:59.207 19:17:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.207 19:17:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.207 19:17:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:59.207 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:59.207 19:17:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.207 19:17:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:59.207 19:17:45 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.207 19:17:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.207 19:17:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.207 19:17:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.207 19:17:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:59.207 Found net devices under 0000:18:00.0: mlx_0_0 00:10:59.207 19:17:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.207 19:17:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.207 19:17:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.207 19:17:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.207 19:17:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:59.207 Found net devices under 0000:18:00.1: mlx_0_1 00:10:59.207 19:17:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.207 19:17:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:59.207 19:17:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:59.207 19:17:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:59.207 19:17:45 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:59.207 19:17:45 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:59.207 19:17:45 -- nvmf/common.sh@58 -- # uname 00:10:59.207 19:17:45 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:59.207 19:17:45 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:59.207 19:17:45 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:59.207 19:17:45 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:59.207 19:17:45 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:59.207 19:17:45 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:59.207 19:17:45 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:59.207 19:17:45 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:59.207 19:17:45 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:59.207 19:17:45 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:59.207 19:17:45 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:59.207 19:17:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.207 19:17:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.207 19:17:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.207 19:17:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.208 19:17:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.208 19:17:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@105 -- # continue 2 00:10:59.208 19:17:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@105 -- # continue 2 00:10:59.208 19:17:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.208 19:17:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.208 19:17:45 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:59.208 19:17:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:59.208 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.208 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:10:59.208 altname enp24s0f0np0 00:10:59.208 altname ens785f0np0 00:10:59.208 inet 192.168.100.8/24 scope global mlx_0_0 00:10:59.208 valid_lft forever preferred_lft forever 00:10:59.208 19:17:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.208 19:17:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.208 19:17:45 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:59.208 19:17:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:59.208 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.208 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:10:59.208 altname enp24s0f1np1 00:10:59.208 altname ens785f1np1 00:10:59.208 inet 192.168.100.9/24 scope global mlx_0_1 00:10:59.208 valid_lft forever preferred_lft forever 00:10:59.208 19:17:45 -- nvmf/common.sh@411 -- # return 0 00:10:59.208 19:17:45 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:59.208 19:17:45 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:59.208 19:17:45 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:59.208 19:17:45 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:59.208 19:17:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.208 19:17:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.208 19:17:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.208 19:17:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.208 19:17:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.208 19:17:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@105 -- # continue 2 00:10:59.208 19:17:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.208 19:17:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.208 19:17:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@105 -- # continue 2 00:10:59.208 19:17:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.208 19:17:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.208 19:17:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.208 19:17:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.208 19:17:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.208 19:17:45 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:59.208 192.168.100.9' 00:10:59.208 19:17:45 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:59.208 192.168.100.9' 00:10:59.208 19:17:45 -- nvmf/common.sh@446 -- # head -n 1 00:10:59.208 19:17:45 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:59.208 19:17:45 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:59.208 192.168.100.9' 00:10:59.208 19:17:45 -- nvmf/common.sh@447 -- # tail -n +2 00:10:59.208 19:17:45 -- nvmf/common.sh@447 -- # head -n 1 00:10:59.208 19:17:45 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:59.208 19:17:45 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:59.208 19:17:45 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:59.208 19:17:45 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:59.208 19:17:45 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:59.208 19:17:45 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:59.208 19:17:45 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:10:59.208 19:17:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:59.208 19:17:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:59.208 19:17:45 -- common/autotest_common.sh@10 -- # set +x 00:10:59.208 19:17:45 -- nvmf/common.sh@470 -- # nvmfpid=2961705 00:10:59.208 19:17:45 -- nvmf/common.sh@471 -- # waitforlisten 2961705 00:10:59.208 19:17:45 -- common/autotest_common.sh@817 -- # '[' -z 2961705 ']' 00:10:59.208 19:17:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:59.208 19:17:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:59.208 19:17:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:59.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:59.208 19:17:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:59.208 19:17:45 -- common/autotest_common.sh@10 -- # set +x 00:10:59.208 19:17:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:10:59.208 [2024-04-24 19:17:45.562859] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:10:59.208 [2024-04-24 19:17:45.562914] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:59.208 EAL: No free 2048 kB hugepages reported on node 1 00:10:59.208 [2024-04-24 19:17:45.635016] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:10:59.208 [2024-04-24 19:17:45.724227] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:59.208 [2024-04-24 19:17:45.724265] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:59.208 [2024-04-24 19:17:45.724274] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:59.208 [2024-04-24 19:17:45.724298] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:59.208 [2024-04-24 19:17:45.724305] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:59.208 [2024-04-24 19:17:45.724356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:59.208 [2024-04-24 19:17:45.724359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:59.467 19:17:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:59.467 19:17:46 -- common/autotest_common.sh@850 -- # return 0 00:10:59.467 19:17:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:59.467 19:17:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:59.467 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.467 19:17:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:59.467 19:17:46 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:59.467 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.467 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.467 [2024-04-24 19:17:46.423191] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22b2c60/0x22b7150) succeed. 00:10:59.467 [2024-04-24 19:17:46.432213] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22b4160/0x22f87e0) succeed. 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:59.726 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.726 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:59.726 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.726 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.726 [2024-04-24 19:17:46.524854] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:59.726 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.726 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.726 NULL1 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:59.726 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.726 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.726 Delay0 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:59.726 19:17:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:59.726 19:17:46 -- common/autotest_common.sh@10 -- # set +x 00:10:59.726 19:17:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@28 -- # perf_pid=2961841 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@30 -- # sleep 2 00:10:59.726 19:17:46 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:10:59.726 EAL: No free 2048 kB hugepages reported on node 1 00:10:59.726 [2024-04-24 19:17:46.631795] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:01.627 19:17:48 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.627 19:17:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.627 19:17:48 -- common/autotest_common.sh@10 -- # set +x 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 NVMe io qpair process completion error 00:11:03.002 19:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:03.002 19:17:49 -- target/delete_subsystem.sh@34 -- # delay=0 00:11:03.002 19:17:49 -- target/delete_subsystem.sh@35 -- # kill -0 2961841 00:11:03.002 19:17:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:03.261 19:17:50 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:03.261 19:17:50 -- target/delete_subsystem.sh@35 -- # kill -0 2961841 00:11:03.261 19:17:50 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Write completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.828 starting I/O failed: -6 00:11:03.828 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 starting I/O failed: -6 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Write completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 Read completed with error (sct=0, sc=8) 00:11:03.829 [2024-04-24 19:17:50.714849] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:11:03.829 19:17:50 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:03.829 19:17:50 -- target/delete_subsystem.sh@35 -- # kill -0 2961841 00:11:03.829 19:17:50 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:03.829 [2024-04-24 19:17:50.730044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:11:03.829 [2024-04-24 19:17:50.730066] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:11:03.829 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:11:03.829 Initializing NVMe Controllers 00:11:03.829 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:03.829 Controller IO queue size 128, less than required. 00:11:03.829 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:03.829 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:03.829 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:03.829 Initialization complete. Launching workers. 00:11:03.829 ======================================================== 00:11:03.829 Latency(us) 00:11:03.829 Device Information : IOPS MiB/s Average min max 00:11:03.829 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.46 0.04 1594141.00 1000082.63 2977162.29 00:11:03.829 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.46 0.04 1595673.24 1001437.49 2978125.34 00:11:03.829 ======================================================== 00:11:03.829 Total : 160.92 0.08 1594907.12 1000082.63 2978125.34 00:11:03.829 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@35 -- # kill -0 2961841 00:11:04.397 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2961841) - No such process 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@45 -- # NOT wait 2961841 00:11:04.397 19:17:51 -- common/autotest_common.sh@638 -- # local es=0 00:11:04.397 19:17:51 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 2961841 00:11:04.397 19:17:51 -- common/autotest_common.sh@626 -- # local arg=wait 00:11:04.397 19:17:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:04.397 19:17:51 -- common/autotest_common.sh@630 -- # type -t wait 00:11:04.397 19:17:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:04.397 19:17:51 -- common/autotest_common.sh@641 -- # wait 2961841 00:11:04.397 19:17:51 -- common/autotest_common.sh@641 -- # es=1 00:11:04.397 19:17:51 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:04.397 19:17:51 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:04.397 19:17:51 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:04.397 19:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:04.397 19:17:51 -- common/autotest_common.sh@10 -- # set +x 00:11:04.397 19:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:04.397 19:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:04.397 19:17:51 -- common/autotest_common.sh@10 -- # set +x 00:11:04.397 [2024-04-24 19:17:51.251255] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:04.397 19:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:04.397 19:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:04.397 19:17:51 -- common/autotest_common.sh@10 -- # set +x 00:11:04.397 19:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@54 -- # perf_pid=2962555 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@56 -- # delay=0 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:04.397 19:17:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:04.397 EAL: No free 2048 kB hugepages reported on node 1 00:11:04.397 [2024-04-24 19:17:51.346816] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:04.963 19:17:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:04.963 19:17:51 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:04.963 19:17:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:05.530 19:17:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:05.530 19:17:52 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:05.530 19:17:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:05.788 19:17:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:05.788 19:17:52 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:05.788 19:17:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:06.354 19:17:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:06.354 19:17:53 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:06.354 19:17:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:06.919 19:17:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:06.919 19:17:53 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:06.919 19:17:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:07.485 19:17:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:07.485 19:17:54 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:07.485 19:17:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:08.051 19:17:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:08.051 19:17:54 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:08.051 19:17:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:08.308 19:17:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:08.308 19:17:55 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:08.308 19:17:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:08.874 19:17:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:08.874 19:17:55 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:08.874 19:17:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:09.439 19:17:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:09.439 19:17:56 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:09.439 19:17:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:10.026 19:17:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:10.026 19:17:56 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:10.026 19:17:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:10.597 19:17:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:10.598 19:17:57 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:10.598 19:17:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:10.854 19:17:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:10.854 19:17:57 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:10.854 19:17:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:11.418 19:17:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:11.418 19:17:58 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:11.418 19:17:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:11.676 Initializing NVMe Controllers 00:11:11.676 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:11.676 Controller IO queue size 128, less than required. 00:11:11.676 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:11.676 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:11.676 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:11.676 Initialization complete. Launching workers. 00:11:11.676 ======================================================== 00:11:11.676 Latency(us) 00:11:11.676 Device Information : IOPS MiB/s Average min max 00:11:11.676 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001233.31 1000058.08 1004527.57 00:11:11.676 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002449.47 1000058.63 1006706.20 00:11:11.676 ======================================================== 00:11:11.676 Total : 256.00 0.12 1001841.39 1000058.08 1006706.20 00:11:11.676 00:11:11.933 19:17:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:11.933 19:17:58 -- target/delete_subsystem.sh@57 -- # kill -0 2962555 00:11:11.933 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2962555) - No such process 00:11:11.933 19:17:58 -- target/delete_subsystem.sh@67 -- # wait 2962555 00:11:11.933 19:17:58 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:11:11.933 19:17:58 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:11:11.933 19:17:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:11.933 19:17:58 -- nvmf/common.sh@117 -- # sync 00:11:11.933 19:17:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:11.933 19:17:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:11.933 19:17:58 -- nvmf/common.sh@120 -- # set +e 00:11:11.933 19:17:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:11.933 19:17:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:11.933 rmmod nvme_rdma 00:11:11.933 rmmod nvme_fabrics 00:11:11.933 19:17:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:11.933 19:17:58 -- nvmf/common.sh@124 -- # set -e 00:11:11.933 19:17:58 -- nvmf/common.sh@125 -- # return 0 00:11:11.933 19:17:58 -- nvmf/common.sh@478 -- # '[' -n 2961705 ']' 00:11:11.933 19:17:58 -- nvmf/common.sh@479 -- # killprocess 2961705 00:11:11.933 19:17:58 -- common/autotest_common.sh@936 -- # '[' -z 2961705 ']' 00:11:11.933 19:17:58 -- common/autotest_common.sh@940 -- # kill -0 2961705 00:11:11.933 19:17:58 -- common/autotest_common.sh@941 -- # uname 00:11:11.933 19:17:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:11.933 19:17:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2961705 00:11:11.933 19:17:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:11.933 19:17:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:11.933 19:17:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2961705' 00:11:11.933 killing process with pid 2961705 00:11:11.933 19:17:58 -- common/autotest_common.sh@955 -- # kill 2961705 00:11:11.933 19:17:58 -- common/autotest_common.sh@960 -- # wait 2961705 00:11:12.191 [2024-04-24 19:17:58.995654] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:12.448 19:17:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:12.448 19:17:59 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:12.448 00:11:12.448 real 0m19.891s 00:11:12.448 user 0m49.805s 00:11:12.448 sys 0m5.938s 00:11:12.448 19:17:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:12.448 19:17:59 -- common/autotest_common.sh@10 -- # set +x 00:11:12.448 ************************************ 00:11:12.448 END TEST nvmf_delete_subsystem 00:11:12.448 ************************************ 00:11:12.448 19:17:59 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:11:12.448 19:17:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:12.448 19:17:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:12.448 19:17:59 -- common/autotest_common.sh@10 -- # set +x 00:11:12.448 ************************************ 00:11:12.448 START TEST nvmf_ns_masking 00:11:12.448 ************************************ 00:11:12.448 19:17:59 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:11:12.707 * Looking for test storage... 00:11:12.707 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:12.707 19:17:59 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:12.707 19:17:59 -- nvmf/common.sh@7 -- # uname -s 00:11:12.707 19:17:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:12.707 19:17:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:12.707 19:17:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:12.707 19:17:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:12.707 19:17:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:12.707 19:17:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:12.707 19:17:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:12.707 19:17:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:12.707 19:17:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:12.707 19:17:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:12.707 19:17:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:11:12.707 19:17:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:11:12.707 19:17:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:12.707 19:17:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:12.707 19:17:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:12.707 19:17:59 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:12.707 19:17:59 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:12.707 19:17:59 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:12.707 19:17:59 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:12.707 19:17:59 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:12.707 19:17:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.707 19:17:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.707 19:17:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.707 19:17:59 -- paths/export.sh@5 -- # export PATH 00:11:12.707 19:17:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.707 19:17:59 -- nvmf/common.sh@47 -- # : 0 00:11:12.707 19:17:59 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:12.707 19:17:59 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:12.707 19:17:59 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:12.707 19:17:59 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:12.707 19:17:59 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:12.707 19:17:59 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:12.707 19:17:59 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:12.707 19:17:59 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:12.707 19:17:59 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:12.707 19:17:59 -- target/ns_masking.sh@11 -- # loops=5 00:11:12.707 19:17:59 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:11:12.707 19:17:59 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:11:12.707 19:17:59 -- target/ns_masking.sh@15 -- # uuidgen 00:11:12.707 19:17:59 -- target/ns_masking.sh@15 -- # HOSTID=77177d12-0d58-4a36-99d9-a7e152b39610 00:11:12.707 19:17:59 -- target/ns_masking.sh@44 -- # nvmftestinit 00:11:12.707 19:17:59 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:12.707 19:17:59 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:12.708 19:17:59 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:12.708 19:17:59 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:12.708 19:17:59 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:12.708 19:17:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:12.708 19:17:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:12.708 19:17:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:12.708 19:17:59 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:12.708 19:17:59 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:12.708 19:17:59 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:12.708 19:17:59 -- common/autotest_common.sh@10 -- # set +x 00:11:19.272 19:18:05 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:19.272 19:18:05 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:19.272 19:18:05 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:19.272 19:18:05 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:19.272 19:18:05 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:19.272 19:18:05 -- nvmf/common.sh@295 -- # net_devs=() 00:11:19.272 19:18:05 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@296 -- # e810=() 00:11:19.272 19:18:05 -- nvmf/common.sh@296 -- # local -ga e810 00:11:19.272 19:18:05 -- nvmf/common.sh@297 -- # x722=() 00:11:19.272 19:18:05 -- nvmf/common.sh@297 -- # local -ga x722 00:11:19.272 19:18:05 -- nvmf/common.sh@298 -- # mlx=() 00:11:19.272 19:18:05 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:19.272 19:18:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:19.272 19:18:05 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:19.272 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:19.272 19:18:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:19.272 19:18:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:19.272 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:19.272 19:18:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:19.272 19:18:05 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.272 19:18:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.272 19:18:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:19.272 Found net devices under 0000:18:00.0: mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.272 19:18:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.272 19:18:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:19.272 Found net devices under 0000:18:00.1: mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.272 19:18:05 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:19.272 19:18:05 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:19.272 19:18:05 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:19.272 19:18:05 -- nvmf/common.sh@58 -- # uname 00:11:19.272 19:18:05 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:19.272 19:18:05 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:19.272 19:18:05 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:19.272 19:18:05 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:19.272 19:18:05 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:19.272 19:18:05 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:19.272 19:18:05 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:19.272 19:18:05 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:19.272 19:18:05 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:19.272 19:18:05 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:19.272 19:18:05 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:19.272 19:18:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:19.272 19:18:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:19.272 19:18:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@105 -- # continue 2 00:11:19.272 19:18:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@105 -- # continue 2 00:11:19.272 19:18:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:19.272 19:18:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.272 19:18:05 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:19.272 19:18:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:19.272 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:19.272 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:11:19.272 altname enp24s0f0np0 00:11:19.272 altname ens785f0np0 00:11:19.272 inet 192.168.100.8/24 scope global mlx_0_0 00:11:19.272 valid_lft forever preferred_lft forever 00:11:19.272 19:18:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:19.272 19:18:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.272 19:18:05 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:19.272 19:18:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:19.272 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:19.272 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:11:19.272 altname enp24s0f1np1 00:11:19.272 altname ens785f1np1 00:11:19.272 inet 192.168.100.9/24 scope global mlx_0_1 00:11:19.272 valid_lft forever preferred_lft forever 00:11:19.272 19:18:05 -- nvmf/common.sh@411 -- # return 0 00:11:19.272 19:18:05 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:19.272 19:18:05 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:19.272 19:18:05 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:19.272 19:18:05 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:19.272 19:18:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:19.272 19:18:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:19.272 19:18:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:19.272 19:18:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:19.272 19:18:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@105 -- # continue 2 00:11:19.272 19:18:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.272 19:18:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:19.272 19:18:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@105 -- # continue 2 00:11:19.272 19:18:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:19.272 19:18:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.272 19:18:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:19.272 19:18:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.272 19:18:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.272 19:18:05 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:19.272 192.168.100.9' 00:11:19.272 19:18:05 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:19.272 192.168.100.9' 00:11:19.272 19:18:05 -- nvmf/common.sh@446 -- # head -n 1 00:11:19.272 19:18:05 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:19.272 19:18:05 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:19.272 192.168.100.9' 00:11:19.272 19:18:05 -- nvmf/common.sh@447 -- # tail -n +2 00:11:19.272 19:18:05 -- nvmf/common.sh@447 -- # head -n 1 00:11:19.272 19:18:05 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:19.272 19:18:05 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:19.272 19:18:05 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:19.272 19:18:05 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:19.272 19:18:05 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:19.272 19:18:05 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:19.272 19:18:05 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:11:19.272 19:18:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:19.272 19:18:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:19.272 19:18:05 -- common/autotest_common.sh@10 -- # set +x 00:11:19.272 19:18:05 -- nvmf/common.sh@470 -- # nvmfpid=2966877 00:11:19.272 19:18:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:19.272 19:18:05 -- nvmf/common.sh@471 -- # waitforlisten 2966877 00:11:19.272 19:18:05 -- common/autotest_common.sh@817 -- # '[' -z 2966877 ']' 00:11:19.272 19:18:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:19.272 19:18:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:19.272 19:18:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:19.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:19.272 19:18:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:19.272 19:18:05 -- common/autotest_common.sh@10 -- # set +x 00:11:19.272 [2024-04-24 19:18:05.528401] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:11:19.272 [2024-04-24 19:18:05.528463] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:19.272 EAL: No free 2048 kB hugepages reported on node 1 00:11:19.272 [2024-04-24 19:18:05.601262] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:19.272 [2024-04-24 19:18:05.686339] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:19.272 [2024-04-24 19:18:05.686381] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:19.272 [2024-04-24 19:18:05.686391] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:19.272 [2024-04-24 19:18:05.686416] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:19.272 [2024-04-24 19:18:05.686423] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:19.272 [2024-04-24 19:18:05.686491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:19.272 [2024-04-24 19:18:05.686598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:19.272 [2024-04-24 19:18:05.686623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:19.272 [2024-04-24 19:18:05.686625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:19.530 19:18:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:19.530 19:18:06 -- common/autotest_common.sh@850 -- # return 0 00:11:19.530 19:18:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:19.530 19:18:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:19.530 19:18:06 -- common/autotest_common.sh@10 -- # set +x 00:11:19.530 19:18:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:19.530 19:18:06 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:19.789 [2024-04-24 19:18:06.574914] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2037240/0x203b730) succeed. 00:11:19.789 [2024-04-24 19:18:06.585347] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2038880/0x207cdc0) succeed. 00:11:19.789 19:18:06 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:11:19.789 19:18:06 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:11:19.789 19:18:06 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:11:20.047 Malloc1 00:11:20.047 19:18:06 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:11:20.305 Malloc2 00:11:20.305 19:18:07 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:20.305 19:18:07 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:11:20.563 19:18:07 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:20.821 [2024-04-24 19:18:07.672415] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:20.821 19:18:07 -- target/ns_masking.sh@61 -- # connect 00:11:20.821 19:18:07 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 77177d12-0d58-4a36-99d9-a7e152b39610 -a 192.168.100.8 -s 4420 -i 4 00:11:21.078 19:18:08 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:11:21.078 19:18:08 -- common/autotest_common.sh@1184 -- # local i=0 00:11:21.079 19:18:08 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:11:21.079 19:18:08 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:11:21.079 19:18:08 -- common/autotest_common.sh@1191 -- # sleep 2 00:11:23.605 19:18:10 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:11:23.605 19:18:10 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:11:23.605 19:18:10 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:11:23.605 19:18:10 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:11:23.605 19:18:10 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:11:23.605 19:18:10 -- common/autotest_common.sh@1194 -- # return 0 00:11:23.605 19:18:10 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:23.605 19:18:10 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:23.605 19:18:10 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:23.605 19:18:10 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:23.605 19:18:10 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:11:23.605 19:18:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:23.605 19:18:10 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:23.605 [ 0]:0x1 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # nguid=7a8ef83d945948a1b449ef263dd9de82 00:11:23.605 19:18:10 -- target/ns_masking.sh@41 -- # [[ 7a8ef83d945948a1b449ef263dd9de82 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:23.605 19:18:10 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:11:23.605 19:18:10 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:11:23.605 19:18:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:23.605 19:18:10 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:23.605 [ 0]:0x1 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:23.605 19:18:10 -- target/ns_masking.sh@40 -- # nguid=7a8ef83d945948a1b449ef263dd9de82 00:11:23.606 19:18:10 -- target/ns_masking.sh@41 -- # [[ 7a8ef83d945948a1b449ef263dd9de82 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:23.606 19:18:10 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:11:23.606 19:18:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:23.606 19:18:10 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:23.606 [ 1]:0x2 00:11:23.606 19:18:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:23.606 19:18:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:23.606 19:18:10 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:23.606 19:18:10 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:23.606 19:18:10 -- target/ns_masking.sh@69 -- # disconnect 00:11:23.606 19:18:10 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:23.863 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.863 19:18:10 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:24.120 19:18:10 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:11:24.378 19:18:11 -- target/ns_masking.sh@77 -- # connect 1 00:11:24.378 19:18:11 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 77177d12-0d58-4a36-99d9-a7e152b39610 -a 192.168.100.8 -s 4420 -i 4 00:11:24.635 19:18:11 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:11:24.635 19:18:11 -- common/autotest_common.sh@1184 -- # local i=0 00:11:24.635 19:18:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:11:24.635 19:18:11 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:11:24.635 19:18:11 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:11:24.635 19:18:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:11:26.533 19:18:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:11:26.533 19:18:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:11:26.533 19:18:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:11:26.533 19:18:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:11:26.533 19:18:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:11:26.533 19:18:13 -- common/autotest_common.sh@1194 -- # return 0 00:11:26.533 19:18:13 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:26.533 19:18:13 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:26.533 19:18:13 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:26.533 19:18:13 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:26.533 19:18:13 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:11:26.533 19:18:13 -- common/autotest_common.sh@638 -- # local es=0 00:11:26.533 19:18:13 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:11:26.533 19:18:13 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:11:26.533 19:18:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:26.533 19:18:13 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:11:26.533 19:18:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:26.533 19:18:13 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:11:26.533 19:18:13 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:26.533 19:18:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:26.533 19:18:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:26.533 19:18:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:26.790 19:18:13 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:26.790 19:18:13 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:26.790 19:18:13 -- common/autotest_common.sh@641 -- # es=1 00:11:26.790 19:18:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:26.790 19:18:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:26.790 19:18:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:26.790 19:18:13 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:11:26.790 19:18:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:26.790 19:18:13 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:26.790 [ 0]:0x2 00:11:26.790 19:18:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:26.790 19:18:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:26.790 19:18:13 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:26.790 19:18:13 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:26.790 19:18:13 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:26.790 19:18:13 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:11:26.790 19:18:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:26.790 19:18:13 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:27.047 [ 0]:0x1 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # nguid=7a8ef83d945948a1b449ef263dd9de82 00:11:27.047 19:18:13 -- target/ns_masking.sh@41 -- # [[ 7a8ef83d945948a1b449ef263dd9de82 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:27.047 19:18:13 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:11:27.047 19:18:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:27.047 19:18:13 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:27.047 [ 1]:0x2 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:27.047 19:18:13 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:27.047 19:18:13 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:27.047 19:18:13 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:27.344 19:18:14 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:11:27.344 19:18:14 -- common/autotest_common.sh@638 -- # local es=0 00:11:27.344 19:18:14 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:11:27.344 19:18:14 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:11:27.344 19:18:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:27.344 19:18:14 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:11:27.344 19:18:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:27.344 19:18:14 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:11:27.344 19:18:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:27.344 19:18:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:27.344 19:18:14 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:27.344 19:18:14 -- common/autotest_common.sh@641 -- # es=1 00:11:27.344 19:18:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:27.344 19:18:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:27.344 19:18:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:27.344 19:18:14 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:11:27.344 19:18:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:27.344 19:18:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:27.344 [ 0]:0x2 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:27.344 19:18:14 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:27.344 19:18:14 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:27.344 19:18:14 -- target/ns_masking.sh@91 -- # disconnect 00:11:27.344 19:18:14 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:27.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.624 19:18:14 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:27.882 19:18:14 -- target/ns_masking.sh@95 -- # connect 2 00:11:27.882 19:18:14 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 77177d12-0d58-4a36-99d9-a7e152b39610 -a 192.168.100.8 -s 4420 -i 4 00:11:28.140 19:18:14 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:11:28.140 19:18:15 -- common/autotest_common.sh@1184 -- # local i=0 00:11:28.140 19:18:15 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:11:28.140 19:18:15 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:11:28.140 19:18:15 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:11:28.140 19:18:15 -- common/autotest_common.sh@1191 -- # sleep 2 00:11:30.042 19:18:17 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:11:30.042 19:18:17 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:11:30.042 19:18:17 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:11:30.042 19:18:17 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:11:30.042 19:18:17 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:11:30.042 19:18:17 -- common/autotest_common.sh@1194 -- # return 0 00:11:30.042 19:18:17 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:30.042 19:18:17 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:30.299 19:18:17 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:30.299 19:18:17 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:30.299 19:18:17 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:11:30.299 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.299 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:30.299 [ 0]:0x1 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # nguid=7a8ef83d945948a1b449ef263dd9de82 00:11:30.299 19:18:17 -- target/ns_masking.sh@41 -- # [[ 7a8ef83d945948a1b449ef263dd9de82 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.299 19:18:17 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:11:30.299 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.299 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:30.299 [ 1]:0x2 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.299 19:18:17 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:30.299 19:18:17 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.299 19:18:17 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:30.558 19:18:17 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:11:30.558 19:18:17 -- common/autotest_common.sh@638 -- # local es=0 00:11:30.558 19:18:17 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:11:30.558 19:18:17 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.558 19:18:17 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:11:30.558 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:30.558 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:30.558 19:18:17 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.558 19:18:17 -- common/autotest_common.sh@641 -- # es=1 00:11:30.558 19:18:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:30.558 19:18:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:30.558 19:18:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:30.558 19:18:17 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:11:30.558 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.558 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:30.558 [ 0]:0x2 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.558 19:18:17 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:30.558 19:18:17 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.558 19:18:17 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:30.558 19:18:17 -- common/autotest_common.sh@638 -- # local es=0 00:11:30.558 19:18:17 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:30.558 19:18:17 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.558 19:18:17 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:30.558 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.558 19:18:17 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:30.558 19:18:17 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:11:30.558 19:18:17 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:30.815 [2024-04-24 19:18:17.620645] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:11:30.815 request: 00:11:30.815 { 00:11:30.815 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:11:30.815 "nsid": 2, 00:11:30.815 "host": "nqn.2016-06.io.spdk:host1", 00:11:30.815 "method": "nvmf_ns_remove_host", 00:11:30.815 "req_id": 1 00:11:30.815 } 00:11:30.815 Got JSON-RPC error response 00:11:30.815 response: 00:11:30.815 { 00:11:30.815 "code": -32602, 00:11:30.815 "message": "Invalid parameters" 00:11:30.815 } 00:11:30.815 19:18:17 -- common/autotest_common.sh@641 -- # es=1 00:11:30.815 19:18:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:30.815 19:18:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:30.815 19:18:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:30.815 19:18:17 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:11:30.815 19:18:17 -- common/autotest_common.sh@638 -- # local es=0 00:11:30.816 19:18:17 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:11:30.816 19:18:17 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:11:30.816 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.816 19:18:17 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:11:30.816 19:18:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:30.816 19:18:17 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:11:30.816 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.816 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:30.816 19:18:17 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.816 19:18:17 -- common/autotest_common.sh@641 -- # es=1 00:11:30.816 19:18:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:30.816 19:18:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:30.816 19:18:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:30.816 19:18:17 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:11:30.816 19:18:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:30.816 19:18:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:30.816 [ 0]:0x2 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:30.816 19:18:17 -- target/ns_masking.sh@40 -- # nguid=558dc9e9e3af49979098b7767a6cbdb0 00:11:30.816 19:18:17 -- target/ns_masking.sh@41 -- # [[ 558dc9e9e3af49979098b7767a6cbdb0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:30.816 19:18:17 -- target/ns_masking.sh@108 -- # disconnect 00:11:30.816 19:18:17 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:31.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.074 19:18:18 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:31.330 19:18:18 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:11:31.330 19:18:18 -- target/ns_masking.sh@114 -- # nvmftestfini 00:11:31.330 19:18:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:31.330 19:18:18 -- nvmf/common.sh@117 -- # sync 00:11:31.330 19:18:18 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:31.330 19:18:18 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:31.330 19:18:18 -- nvmf/common.sh@120 -- # set +e 00:11:31.330 19:18:18 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:31.330 19:18:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:31.330 rmmod nvme_rdma 00:11:31.330 rmmod nvme_fabrics 00:11:31.330 19:18:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:31.330 19:18:18 -- nvmf/common.sh@124 -- # set -e 00:11:31.330 19:18:18 -- nvmf/common.sh@125 -- # return 0 00:11:31.330 19:18:18 -- nvmf/common.sh@478 -- # '[' -n 2966877 ']' 00:11:31.330 19:18:18 -- nvmf/common.sh@479 -- # killprocess 2966877 00:11:31.330 19:18:18 -- common/autotest_common.sh@936 -- # '[' -z 2966877 ']' 00:11:31.330 19:18:18 -- common/autotest_common.sh@940 -- # kill -0 2966877 00:11:31.330 19:18:18 -- common/autotest_common.sh@941 -- # uname 00:11:31.330 19:18:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:31.330 19:18:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2966877 00:11:31.587 19:18:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:31.587 19:18:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:31.587 19:18:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2966877' 00:11:31.587 killing process with pid 2966877 00:11:31.587 19:18:18 -- common/autotest_common.sh@955 -- # kill 2966877 00:11:31.587 19:18:18 -- common/autotest_common.sh@960 -- # wait 2966877 00:11:31.587 [2024-04-24 19:18:18.436807] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:31.844 19:18:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:31.844 19:18:18 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:31.844 00:11:31.844 real 0m19.319s 00:11:31.844 user 0m56.221s 00:11:31.844 sys 0m6.177s 00:11:31.844 19:18:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:31.844 19:18:18 -- common/autotest_common.sh@10 -- # set +x 00:11:31.844 ************************************ 00:11:31.844 END TEST nvmf_ns_masking 00:11:31.844 ************************************ 00:11:31.844 19:18:18 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:11:31.844 19:18:18 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:11:31.844 19:18:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:31.844 19:18:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:31.844 19:18:18 -- common/autotest_common.sh@10 -- # set +x 00:11:32.102 ************************************ 00:11:32.102 START TEST nvmf_nvme_cli 00:11:32.102 ************************************ 00:11:32.102 19:18:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:11:32.102 * Looking for test storage... 00:11:32.102 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:32.102 19:18:18 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:32.102 19:18:18 -- nvmf/common.sh@7 -- # uname -s 00:11:32.102 19:18:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:32.102 19:18:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:32.102 19:18:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:32.102 19:18:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:32.102 19:18:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:32.102 19:18:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:32.102 19:18:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:32.102 19:18:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:32.102 19:18:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:32.102 19:18:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:32.102 19:18:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:11:32.102 19:18:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:11:32.102 19:18:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:32.102 19:18:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:32.102 19:18:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:32.102 19:18:19 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:32.102 19:18:19 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:32.102 19:18:19 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:32.103 19:18:19 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:32.103 19:18:19 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:32.103 19:18:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.103 19:18:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.103 19:18:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.103 19:18:19 -- paths/export.sh@5 -- # export PATH 00:11:32.103 19:18:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:32.103 19:18:19 -- nvmf/common.sh@47 -- # : 0 00:11:32.103 19:18:19 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:32.103 19:18:19 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:32.103 19:18:19 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:32.103 19:18:19 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:32.103 19:18:19 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:32.103 19:18:19 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:32.103 19:18:19 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:32.103 19:18:19 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:32.103 19:18:19 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:32.103 19:18:19 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:32.103 19:18:19 -- target/nvme_cli.sh@14 -- # devs=() 00:11:32.103 19:18:19 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:11:32.103 19:18:19 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:32.103 19:18:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:32.103 19:18:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:32.103 19:18:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:32.103 19:18:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:32.103 19:18:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:32.103 19:18:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:32.103 19:18:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:32.103 19:18:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:32.103 19:18:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:32.103 19:18:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:32.103 19:18:19 -- common/autotest_common.sh@10 -- # set +x 00:11:38.660 19:18:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:38.660 19:18:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:38.660 19:18:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:38.660 19:18:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:38.660 19:18:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:38.660 19:18:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:38.660 19:18:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:38.660 19:18:24 -- nvmf/common.sh@295 -- # net_devs=() 00:11:38.660 19:18:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:38.660 19:18:24 -- nvmf/common.sh@296 -- # e810=() 00:11:38.660 19:18:24 -- nvmf/common.sh@296 -- # local -ga e810 00:11:38.660 19:18:24 -- nvmf/common.sh@297 -- # x722=() 00:11:38.660 19:18:24 -- nvmf/common.sh@297 -- # local -ga x722 00:11:38.660 19:18:24 -- nvmf/common.sh@298 -- # mlx=() 00:11:38.660 19:18:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:38.660 19:18:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:38.660 19:18:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:38.660 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:38.660 19:18:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:38.660 19:18:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:38.660 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:38.660 19:18:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:38.660 19:18:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.660 19:18:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.660 19:18:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:38.660 Found net devices under 0000:18:00.0: mlx_0_0 00:11:38.660 19:18:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.660 19:18:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.660 19:18:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:38.660 Found net devices under 0000:18:00.1: mlx_0_1 00:11:38.660 19:18:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.660 19:18:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:38.660 19:18:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:38.660 19:18:24 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:38.660 19:18:24 -- nvmf/common.sh@58 -- # uname 00:11:38.660 19:18:24 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:38.660 19:18:24 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:38.660 19:18:24 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:38.660 19:18:24 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:38.660 19:18:24 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:38.660 19:18:24 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:38.660 19:18:24 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:38.660 19:18:24 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:38.660 19:18:24 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:38.660 19:18:24 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:38.660 19:18:24 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:38.660 19:18:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:38.660 19:18:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:38.660 19:18:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:38.660 19:18:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:38.660 19:18:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:38.660 19:18:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:38.660 19:18:24 -- nvmf/common.sh@105 -- # continue 2 00:11:38.660 19:18:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:38.660 19:18:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:38.660 19:18:24 -- nvmf/common.sh@105 -- # continue 2 00:11:38.660 19:18:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:38.660 19:18:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:38.660 19:18:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:38.660 19:18:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:38.660 19:18:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:38.660 19:18:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:38.660 19:18:25 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:38.660 19:18:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:38.660 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:38.660 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:11:38.660 altname enp24s0f0np0 00:11:38.660 altname ens785f0np0 00:11:38.660 inet 192.168.100.8/24 scope global mlx_0_0 00:11:38.660 valid_lft forever preferred_lft forever 00:11:38.660 19:18:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:38.660 19:18:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:38.660 19:18:25 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:38.660 19:18:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:38.660 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:38.660 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:11:38.660 altname enp24s0f1np1 00:11:38.660 altname ens785f1np1 00:11:38.660 inet 192.168.100.9/24 scope global mlx_0_1 00:11:38.660 valid_lft forever preferred_lft forever 00:11:38.660 19:18:25 -- nvmf/common.sh@411 -- # return 0 00:11:38.660 19:18:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:38.660 19:18:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:38.660 19:18:25 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:38.660 19:18:25 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:38.660 19:18:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:38.660 19:18:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:38.660 19:18:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:38.660 19:18:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:38.660 19:18:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:38.660 19:18:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:38.660 19:18:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:38.660 19:18:25 -- nvmf/common.sh@105 -- # continue 2 00:11:38.660 19:18:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:38.660 19:18:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:38.660 19:18:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:38.660 19:18:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@105 -- # continue 2 00:11:38.660 19:18:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:38.660 19:18:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:38.660 19:18:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:38.660 19:18:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:38.660 19:18:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:38.660 19:18:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:38.660 19:18:25 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:38.660 192.168.100.9' 00:11:38.660 19:18:25 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:38.660 192.168.100.9' 00:11:38.660 19:18:25 -- nvmf/common.sh@446 -- # head -n 1 00:11:38.660 19:18:25 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:38.660 19:18:25 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:38.660 192.168.100.9' 00:11:38.660 19:18:25 -- nvmf/common.sh@447 -- # tail -n +2 00:11:38.660 19:18:25 -- nvmf/common.sh@447 -- # head -n 1 00:11:38.660 19:18:25 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:38.660 19:18:25 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:38.660 19:18:25 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:38.660 19:18:25 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:38.660 19:18:25 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:38.660 19:18:25 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:38.660 19:18:25 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:11:38.660 19:18:25 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:38.660 19:18:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:38.660 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:11:38.660 19:18:25 -- nvmf/common.sh@470 -- # nvmfpid=2971651 00:11:38.660 19:18:25 -- nvmf/common.sh@471 -- # waitforlisten 2971651 00:11:38.660 19:18:25 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:38.660 19:18:25 -- common/autotest_common.sh@817 -- # '[' -z 2971651 ']' 00:11:38.660 19:18:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:38.660 19:18:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:38.660 19:18:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:38.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:38.660 19:18:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:38.660 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:11:38.660 [2024-04-24 19:18:25.192524] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:11:38.660 [2024-04-24 19:18:25.192592] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:38.660 EAL: No free 2048 kB hugepages reported on node 1 00:11:38.660 [2024-04-24 19:18:25.267218] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:38.660 [2024-04-24 19:18:25.358315] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:38.660 [2024-04-24 19:18:25.358359] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:38.660 [2024-04-24 19:18:25.358370] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:38.660 [2024-04-24 19:18:25.358382] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:38.660 [2024-04-24 19:18:25.358390] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:38.660 [2024-04-24 19:18:25.358449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:38.660 [2024-04-24 19:18:25.358542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:38.660 [2024-04-24 19:18:25.358566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:38.660 [2024-04-24 19:18:25.358570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:39.226 19:18:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:39.226 19:18:26 -- common/autotest_common.sh@850 -- # return 0 00:11:39.226 19:18:26 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:39.226 19:18:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:39.226 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.226 19:18:26 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:39.226 19:18:26 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:39.226 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.226 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.226 [2024-04-24 19:18:26.080147] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22c2240/0x22c6730) succeed. 00:11:39.226 [2024-04-24 19:18:26.090566] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22c3880/0x2307dc0) succeed. 00:11:39.226 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.226 19:18:26 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:11:39.226 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.226 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.226 Malloc0 00:11:39.226 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.226 19:18:26 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:39.226 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.226 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.484 Malloc1 00:11:39.484 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.484 19:18:26 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:11:39.484 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.484 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.484 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.484 19:18:26 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:39.484 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.484 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.484 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.484 19:18:26 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:39.484 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.484 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.484 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.485 19:18:26 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:39.485 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.485 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.485 [2024-04-24 19:18:26.301397] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:39.485 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.485 19:18:26 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:39.485 19:18:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:39.485 19:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:39.485 19:18:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:39.485 19:18:26 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:11:39.485 00:11:39.485 Discovery Log Number of Records 2, Generation counter 2 00:11:39.485 =====Discovery Log Entry 0====== 00:11:39.485 trtype: rdma 00:11:39.485 adrfam: ipv4 00:11:39.485 subtype: current discovery subsystem 00:11:39.485 treq: not required 00:11:39.485 portid: 0 00:11:39.485 trsvcid: 4420 00:11:39.485 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:11:39.485 traddr: 192.168.100.8 00:11:39.485 eflags: explicit discovery connections, duplicate discovery information 00:11:39.485 rdma_prtype: not specified 00:11:39.485 rdma_qptype: connected 00:11:39.485 rdma_cms: rdma-cm 00:11:39.485 rdma_pkey: 0x0000 00:11:39.485 =====Discovery Log Entry 1====== 00:11:39.485 trtype: rdma 00:11:39.485 adrfam: ipv4 00:11:39.485 subtype: nvme subsystem 00:11:39.485 treq: not required 00:11:39.485 portid: 0 00:11:39.485 trsvcid: 4420 00:11:39.485 subnqn: nqn.2016-06.io.spdk:cnode1 00:11:39.485 traddr: 192.168.100.8 00:11:39.485 eflags: none 00:11:39.485 rdma_prtype: not specified 00:11:39.485 rdma_qptype: connected 00:11:39.485 rdma_cms: rdma-cm 00:11:39.485 rdma_pkey: 0x0000 00:11:39.485 19:18:26 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:11:39.485 19:18:26 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:11:39.485 19:18:26 -- nvmf/common.sh@511 -- # local dev _ 00:11:39.485 19:18:26 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:39.485 19:18:26 -- nvmf/common.sh@510 -- # nvme list 00:11:39.485 19:18:26 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:39.485 19:18:26 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:39.485 19:18:26 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:39.485 19:18:26 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:39.485 19:18:26 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:11:39.485 19:18:26 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:11:40.419 19:18:27 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:11:40.419 19:18:27 -- common/autotest_common.sh@1184 -- # local i=0 00:11:40.419 19:18:27 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.419 19:18:27 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:11:40.419 19:18:27 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:11:40.419 19:18:27 -- common/autotest_common.sh@1191 -- # sleep 2 00:11:42.948 19:18:29 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:11:42.948 19:18:29 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:11:42.948 19:18:29 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:11:42.948 19:18:29 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:11:42.948 19:18:29 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:11:42.948 19:18:29 -- common/autotest_common.sh@1194 -- # return 0 00:11:42.948 19:18:29 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:11:42.948 19:18:29 -- nvmf/common.sh@511 -- # local dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@510 -- # nvme list 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:11:42.948 /dev/nvme0n1 ]] 00:11:42.948 19:18:29 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:11:42.948 19:18:29 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:11:42.948 19:18:29 -- nvmf/common.sh@511 -- # local dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@510 -- # nvme list 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:11:42.948 19:18:29 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:11:42.948 19:18:29 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:42.948 19:18:29 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:11:42.948 19:18:29 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:43.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.513 19:18:30 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:43.513 19:18:30 -- common/autotest_common.sh@1205 -- # local i=0 00:11:43.513 19:18:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:11:43.513 19:18:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.513 19:18:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:11:43.513 19:18:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:43.513 19:18:30 -- common/autotest_common.sh@1217 -- # return 0 00:11:43.513 19:18:30 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:11:43.513 19:18:30 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:43.513 19:18:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:43.513 19:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:43.513 19:18:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:43.513 19:18:30 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:11:43.513 19:18:30 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:11:43.513 19:18:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:43.513 19:18:30 -- nvmf/common.sh@117 -- # sync 00:11:43.513 19:18:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:43.513 19:18:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:43.513 19:18:30 -- nvmf/common.sh@120 -- # set +e 00:11:43.513 19:18:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:43.513 19:18:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:43.513 rmmod nvme_rdma 00:11:43.513 rmmod nvme_fabrics 00:11:43.513 19:18:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:43.513 19:18:30 -- nvmf/common.sh@124 -- # set -e 00:11:43.513 19:18:30 -- nvmf/common.sh@125 -- # return 0 00:11:43.513 19:18:30 -- nvmf/common.sh@478 -- # '[' -n 2971651 ']' 00:11:43.514 19:18:30 -- nvmf/common.sh@479 -- # killprocess 2971651 00:11:43.514 19:18:30 -- common/autotest_common.sh@936 -- # '[' -z 2971651 ']' 00:11:43.514 19:18:30 -- common/autotest_common.sh@940 -- # kill -0 2971651 00:11:43.514 19:18:30 -- common/autotest_common.sh@941 -- # uname 00:11:43.514 19:18:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:43.772 19:18:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2971651 00:11:43.772 19:18:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:43.772 19:18:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:43.772 19:18:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2971651' 00:11:43.772 killing process with pid 2971651 00:11:43.772 19:18:30 -- common/autotest_common.sh@955 -- # kill 2971651 00:11:43.772 19:18:30 -- common/autotest_common.sh@960 -- # wait 2971651 00:11:43.772 [2024-04-24 19:18:30.660626] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:44.030 19:18:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:44.030 19:18:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:44.030 00:11:44.030 real 0m12.054s 00:11:44.030 user 0m23.786s 00:11:44.030 sys 0m5.322s 00:11:44.030 19:18:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:44.030 19:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:44.030 ************************************ 00:11:44.030 END TEST nvmf_nvme_cli 00:11:44.030 ************************************ 00:11:44.030 19:18:30 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:11:44.030 19:18:30 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:11:44.030 19:18:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:44.030 19:18:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:44.030 19:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:44.289 ************************************ 00:11:44.289 START TEST nvmf_host_management 00:11:44.289 ************************************ 00:11:44.289 19:18:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:11:44.289 * Looking for test storage... 00:11:44.289 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:44.289 19:18:31 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:44.289 19:18:31 -- nvmf/common.sh@7 -- # uname -s 00:11:44.289 19:18:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:44.289 19:18:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:44.289 19:18:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:44.289 19:18:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:44.289 19:18:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:44.289 19:18:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:44.289 19:18:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:44.289 19:18:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:44.289 19:18:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:44.289 19:18:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:44.289 19:18:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:11:44.289 19:18:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:11:44.289 19:18:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:44.289 19:18:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:44.289 19:18:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:44.289 19:18:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:44.289 19:18:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:44.289 19:18:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:44.289 19:18:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:44.289 19:18:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:44.289 19:18:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.289 19:18:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.289 19:18:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.289 19:18:31 -- paths/export.sh@5 -- # export PATH 00:11:44.289 19:18:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.289 19:18:31 -- nvmf/common.sh@47 -- # : 0 00:11:44.289 19:18:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:44.289 19:18:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:44.289 19:18:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:44.289 19:18:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:44.289 19:18:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:44.289 19:18:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:44.289 19:18:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:44.289 19:18:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:44.289 19:18:31 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:44.289 19:18:31 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:44.289 19:18:31 -- target/host_management.sh@105 -- # nvmftestinit 00:11:44.289 19:18:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:44.289 19:18:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:44.289 19:18:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:44.289 19:18:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:44.289 19:18:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:44.289 19:18:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:44.289 19:18:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:44.289 19:18:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:44.289 19:18:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:44.289 19:18:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:44.289 19:18:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:44.289 19:18:31 -- common/autotest_common.sh@10 -- # set +x 00:11:50.853 19:18:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:50.854 19:18:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:50.854 19:18:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:50.854 19:18:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:50.854 19:18:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:50.854 19:18:37 -- nvmf/common.sh@295 -- # net_devs=() 00:11:50.854 19:18:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@296 -- # e810=() 00:11:50.854 19:18:37 -- nvmf/common.sh@296 -- # local -ga e810 00:11:50.854 19:18:37 -- nvmf/common.sh@297 -- # x722=() 00:11:50.854 19:18:37 -- nvmf/common.sh@297 -- # local -ga x722 00:11:50.854 19:18:37 -- nvmf/common.sh@298 -- # mlx=() 00:11:50.854 19:18:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:50.854 19:18:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:50.854 19:18:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:50.854 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:50.854 19:18:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:50.854 19:18:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:50.854 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:50.854 19:18:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:50.854 19:18:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:50.854 19:18:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:50.854 19:18:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:50.854 Found net devices under 0000:18:00.0: mlx_0_0 00:11:50.854 19:18:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:50.854 19:18:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:50.854 19:18:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:50.854 Found net devices under 0000:18:00.1: mlx_0_1 00:11:50.854 19:18:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:50.854 19:18:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:50.854 19:18:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:50.854 19:18:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:50.854 19:18:37 -- nvmf/common.sh@58 -- # uname 00:11:50.854 19:18:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:50.854 19:18:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:50.854 19:18:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:50.854 19:18:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:50.854 19:18:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:50.854 19:18:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:50.854 19:18:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:50.854 19:18:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:50.854 19:18:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:50.854 19:18:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:50.854 19:18:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:50.854 19:18:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:50.854 19:18:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:50.854 19:18:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:50.854 19:18:37 -- nvmf/common.sh@105 -- # continue 2 00:11:50.854 19:18:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:50.854 19:18:37 -- nvmf/common.sh@105 -- # continue 2 00:11:50.854 19:18:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:50.854 19:18:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:50.854 19:18:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:50.854 19:18:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:50.854 19:18:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:50.854 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:50.854 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:11:50.854 altname enp24s0f0np0 00:11:50.854 altname ens785f0np0 00:11:50.854 inet 192.168.100.8/24 scope global mlx_0_0 00:11:50.854 valid_lft forever preferred_lft forever 00:11:50.854 19:18:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:50.854 19:18:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:50.854 19:18:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:50.854 19:18:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:50.854 19:18:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:50.854 19:18:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:50.854 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:50.854 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:11:50.854 altname enp24s0f1np1 00:11:50.854 altname ens785f1np1 00:11:50.854 inet 192.168.100.9/24 scope global mlx_0_1 00:11:50.854 valid_lft forever preferred_lft forever 00:11:50.854 19:18:37 -- nvmf/common.sh@411 -- # return 0 00:11:50.854 19:18:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:50.854 19:18:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:50.854 19:18:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:50.854 19:18:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:50.854 19:18:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:50.854 19:18:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:50.854 19:18:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:50.854 19:18:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:50.854 19:18:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.854 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:50.854 19:18:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:50.855 19:18:37 -- nvmf/common.sh@105 -- # continue 2 00:11:50.855 19:18:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:50.855 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.855 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:50.855 19:18:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:50.855 19:18:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:50.855 19:18:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:50.855 19:18:37 -- nvmf/common.sh@105 -- # continue 2 00:11:50.855 19:18:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:50.855 19:18:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:50.855 19:18:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:50.855 19:18:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:50.855 19:18:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:50.855 19:18:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:50.855 19:18:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:50.855 19:18:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:50.855 192.168.100.9' 00:11:50.855 19:18:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:50.855 192.168.100.9' 00:11:50.855 19:18:37 -- nvmf/common.sh@446 -- # head -n 1 00:11:50.855 19:18:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:50.855 19:18:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:50.855 192.168.100.9' 00:11:50.855 19:18:37 -- nvmf/common.sh@447 -- # tail -n +2 00:11:50.855 19:18:37 -- nvmf/common.sh@447 -- # head -n 1 00:11:50.855 19:18:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:50.855 19:18:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:50.855 19:18:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:50.855 19:18:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:50.855 19:18:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:50.855 19:18:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:50.855 19:18:37 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:11:50.855 19:18:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:11:50.855 19:18:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:50.855 19:18:37 -- common/autotest_common.sh@10 -- # set +x 00:11:51.114 ************************************ 00:11:51.114 START TEST nvmf_host_management 00:11:51.114 ************************************ 00:11:51.114 19:18:37 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:11:51.114 19:18:37 -- target/host_management.sh@69 -- # starttarget 00:11:51.114 19:18:37 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:11:51.114 19:18:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:51.114 19:18:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:51.114 19:18:37 -- common/autotest_common.sh@10 -- # set +x 00:11:51.114 19:18:37 -- nvmf/common.sh@470 -- # nvmfpid=2975471 00:11:51.114 19:18:37 -- nvmf/common.sh@471 -- # waitforlisten 2975471 00:11:51.114 19:18:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:11:51.114 19:18:37 -- common/autotest_common.sh@817 -- # '[' -z 2975471 ']' 00:11:51.114 19:18:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:51.114 19:18:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:51.114 19:18:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:51.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:51.114 19:18:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:51.114 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:11:51.114 [2024-04-24 19:18:38.047731] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:11:51.114 [2024-04-24 19:18:38.047787] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:51.114 EAL: No free 2048 kB hugepages reported on node 1 00:11:51.114 [2024-04-24 19:18:38.119598] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:51.373 [2024-04-24 19:18:38.207617] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:51.373 [2024-04-24 19:18:38.207661] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:51.373 [2024-04-24 19:18:38.207671] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:51.373 [2024-04-24 19:18:38.207696] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:51.373 [2024-04-24 19:18:38.207703] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:51.373 [2024-04-24 19:18:38.207803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:51.373 [2024-04-24 19:18:38.207885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:51.373 [2024-04-24 19:18:38.207987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:51.373 [2024-04-24 19:18:38.207988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:11:51.938 19:18:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:51.938 19:18:38 -- common/autotest_common.sh@850 -- # return 0 00:11:51.938 19:18:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:51.938 19:18:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:51.938 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:11:51.938 19:18:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:51.938 19:18:38 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:51.938 19:18:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:51.938 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:11:51.939 [2024-04-24 19:18:38.939369] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c3c530/0x1c40a20) succeed. 00:11:51.939 [2024-04-24 19:18:38.949837] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c3db70/0x1c820b0) succeed. 00:11:52.197 19:18:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:52.197 19:18:39 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:11:52.197 19:18:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:52.197 19:18:39 -- common/autotest_common.sh@10 -- # set +x 00:11:52.197 19:18:39 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:11:52.197 19:18:39 -- target/host_management.sh@23 -- # cat 00:11:52.197 19:18:39 -- target/host_management.sh@30 -- # rpc_cmd 00:11:52.197 19:18:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:52.197 19:18:39 -- common/autotest_common.sh@10 -- # set +x 00:11:52.197 Malloc0 00:11:52.197 [2024-04-24 19:18:39.132469] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:52.197 19:18:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:52.197 19:18:39 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:11:52.197 19:18:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:52.197 19:18:39 -- common/autotest_common.sh@10 -- # set +x 00:11:52.197 19:18:39 -- target/host_management.sh@73 -- # perfpid=2975693 00:11:52.197 19:18:39 -- target/host_management.sh@74 -- # waitforlisten 2975693 /var/tmp/bdevperf.sock 00:11:52.197 19:18:39 -- common/autotest_common.sh@817 -- # '[' -z 2975693 ']' 00:11:52.197 19:18:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:52.197 19:18:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:52.197 19:18:39 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:11:52.197 19:18:39 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:11:52.197 19:18:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:52.197 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:52.197 19:18:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:52.197 19:18:39 -- nvmf/common.sh@521 -- # config=() 00:11:52.197 19:18:39 -- common/autotest_common.sh@10 -- # set +x 00:11:52.197 19:18:39 -- nvmf/common.sh@521 -- # local subsystem config 00:11:52.197 19:18:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:11:52.197 19:18:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:11:52.197 { 00:11:52.197 "params": { 00:11:52.197 "name": "Nvme$subsystem", 00:11:52.197 "trtype": "$TEST_TRANSPORT", 00:11:52.197 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:52.197 "adrfam": "ipv4", 00:11:52.197 "trsvcid": "$NVMF_PORT", 00:11:52.197 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:52.197 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:52.197 "hdgst": ${hdgst:-false}, 00:11:52.197 "ddgst": ${ddgst:-false} 00:11:52.197 }, 00:11:52.197 "method": "bdev_nvme_attach_controller" 00:11:52.197 } 00:11:52.197 EOF 00:11:52.197 )") 00:11:52.197 19:18:39 -- nvmf/common.sh@543 -- # cat 00:11:52.197 19:18:39 -- nvmf/common.sh@545 -- # jq . 00:11:52.197 19:18:39 -- nvmf/common.sh@546 -- # IFS=, 00:11:52.197 19:18:39 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:11:52.197 "params": { 00:11:52.197 "name": "Nvme0", 00:11:52.197 "trtype": "rdma", 00:11:52.197 "traddr": "192.168.100.8", 00:11:52.197 "adrfam": "ipv4", 00:11:52.197 "trsvcid": "4420", 00:11:52.197 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:52.197 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:52.197 "hdgst": false, 00:11:52.197 "ddgst": false 00:11:52.197 }, 00:11:52.197 "method": "bdev_nvme_attach_controller" 00:11:52.197 }' 00:11:52.457 [2024-04-24 19:18:39.238796] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:11:52.457 [2024-04-24 19:18:39.238861] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2975693 ] 00:11:52.457 EAL: No free 2048 kB hugepages reported on node 1 00:11:52.457 [2024-04-24 19:18:39.313334] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:52.457 [2024-04-24 19:18:39.394571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:52.715 Running I/O for 10 seconds... 00:11:53.282 19:18:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:53.282 19:18:40 -- common/autotest_common.sh@850 -- # return 0 00:11:53.282 19:18:40 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:11:53.282 19:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:53.282 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:11:53.282 19:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:53.282 19:18:40 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:53.282 19:18:40 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:11:53.282 19:18:40 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:11:53.282 19:18:40 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:11:53.282 19:18:40 -- target/host_management.sh@52 -- # local ret=1 00:11:53.282 19:18:40 -- target/host_management.sh@53 -- # local i 00:11:53.282 19:18:40 -- target/host_management.sh@54 -- # (( i = 10 )) 00:11:53.282 19:18:40 -- target/host_management.sh@54 -- # (( i != 0 )) 00:11:53.282 19:18:40 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:11:53.282 19:18:40 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:11:53.282 19:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:53.282 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:11:53.282 19:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:53.282 19:18:40 -- target/host_management.sh@55 -- # read_io_count=1515 00:11:53.282 19:18:40 -- target/host_management.sh@58 -- # '[' 1515 -ge 100 ']' 00:11:53.282 19:18:40 -- target/host_management.sh@59 -- # ret=0 00:11:53.282 19:18:40 -- target/host_management.sh@60 -- # break 00:11:53.282 19:18:40 -- target/host_management.sh@64 -- # return 0 00:11:53.282 19:18:40 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:53.282 19:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:53.282 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:11:53.282 19:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:53.282 19:18:40 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:53.282 19:18:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:53.282 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:11:53.282 19:18:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:53.282 19:18:40 -- target/host_management.sh@87 -- # sleep 1 00:11:54.218 [2024-04-24 19:18:41.153511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:11:54.218 [2024-04-24 19:18:41.153553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:fa3b60b0 sqhd:0000 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.153565] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:11:54.218 [2024-04-24 19:18:41.153575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:fa3b60b0 sqhd:0000 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.153586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:11:54.218 [2024-04-24 19:18:41.153595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:fa3b60b0 sqhd:0000 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.153605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:11:54.218 [2024-04-24 19:18:41.153619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:fa3b60b0 sqhd:0000 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:11:54.218 [2024-04-24 19:18:41.155778] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:11:54.218 [2024-04-24 19:18:41.155798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:81920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:82048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:82176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:82304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:82432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:82560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:82688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:82816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.155980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.155994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:83072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:83200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:83328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:83456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:83584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:11:54.218 [2024-04-24 19:18:41.156120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:83712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192d1e80 len:0x10000 key:0x182800 00:11:54.218 [2024-04-24 19:18:41.156143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.218 [2024-04-24 19:18:41.156156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:83840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192c1e00 len:0x10000 key:0x182800 00:11:54.218 [2024-04-24 19:18:41.156166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:83968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192b1d80 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:84096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192a1d00 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:84224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019291c80 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:84352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019281c00 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:84480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019271b80 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:84608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019261b00 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:84736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019251a80 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:84864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019241a00 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:84992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019231980 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:85120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019221900 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:85248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019211880 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:85376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019201800 len:0x10000 key:0x182800 00:11:54.219 [2024-04-24 19:18:41.156444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:85504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:85632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:85760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:85888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:86016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:86144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:86272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:86400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:86528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:86656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:86784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:86912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:11:54.219 [2024-04-24 19:18:41.156727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bab4000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bad5000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:79104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be2f000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:79232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be0e000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:79360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bded000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.219 [2024-04-24 19:18:41.156860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdcc000 len:0x10000 key:0x182400 00:11:54.219 [2024-04-24 19:18:41.156870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:79616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdab000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.156893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:79744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd8a000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.156916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:79872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8ff000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.156939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:80000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8de000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.156962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:80128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8bd000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.156985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.156999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:80256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d89c000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:80384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d87b000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:80512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d85a000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:80640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d839000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:80768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d818000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:80896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7f7000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7d6000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:81152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7b5000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:81280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d794000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d773000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:81536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d752000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:81664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d731000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 [2024-04-24 19:18:41.157276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:81792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d710000 len:0x10000 key:0x182400 00:11:54.220 [2024-04-24 19:18:41.157286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:24003 cdw0:192ed080 sqhd:9600 p:0 m:0 dnr:0 00:11:54.220 19:18:41 -- target/host_management.sh@91 -- # kill -9 2975693 00:11:54.220 19:18:41 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:11:54.220 19:18:41 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:11:54.220 19:18:41 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:11:54.220 19:18:41 -- nvmf/common.sh@521 -- # config=() 00:11:54.220 19:18:41 -- nvmf/common.sh@521 -- # local subsystem config 00:11:54.220 19:18:41 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:11:54.220 19:18:41 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:11:54.220 { 00:11:54.220 "params": { 00:11:54.220 "name": "Nvme$subsystem", 00:11:54.220 "trtype": "$TEST_TRANSPORT", 00:11:54.220 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:54.220 "adrfam": "ipv4", 00:11:54.220 "trsvcid": "$NVMF_PORT", 00:11:54.220 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:54.220 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:54.220 "hdgst": ${hdgst:-false}, 00:11:54.220 "ddgst": ${ddgst:-false} 00:11:54.220 }, 00:11:54.220 "method": "bdev_nvme_attach_controller" 00:11:54.220 } 00:11:54.220 EOF 00:11:54.220 )") 00:11:54.220 19:18:41 -- nvmf/common.sh@543 -- # cat 00:11:54.220 19:18:41 -- nvmf/common.sh@545 -- # jq . 00:11:54.220 19:18:41 -- nvmf/common.sh@546 -- # IFS=, 00:11:54.220 19:18:41 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:11:54.220 "params": { 00:11:54.220 "name": "Nvme0", 00:11:54.220 "trtype": "rdma", 00:11:54.220 "traddr": "192.168.100.8", 00:11:54.220 "adrfam": "ipv4", 00:11:54.220 "trsvcid": "4420", 00:11:54.220 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:54.220 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:54.220 "hdgst": false, 00:11:54.220 "ddgst": false 00:11:54.220 }, 00:11:54.220 "method": "bdev_nvme_attach_controller" 00:11:54.220 }' 00:11:54.220 [2024-04-24 19:18:41.206444] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:11:54.220 [2024-04-24 19:18:41.206505] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2975895 ] 00:11:54.479 EAL: No free 2048 kB hugepages reported on node 1 00:11:54.479 [2024-04-24 19:18:41.279859] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:54.479 [2024-04-24 19:18:41.364019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:54.738 Running I/O for 1 seconds... 00:11:55.673 00:11:55.673 Latency(us) 00:11:55.673 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:55.673 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:11:55.673 Verification LBA range: start 0x0 length 0x400 00:11:55.673 Nvme0n1 : 1.01 3030.43 189.40 0.00 0.00 20687.50 612.62 42626.89 00:11:55.673 =================================================================================================================== 00:11:55.673 Total : 3030.43 189.40 0.00 0.00 20687.50 612.62 42626.89 00:11:55.932 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 2975693 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:11:55.932 19:18:42 -- target/host_management.sh@102 -- # stoptarget 00:11:55.932 19:18:42 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:11:55.932 19:18:42 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:11:55.933 19:18:42 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:11:55.933 19:18:42 -- target/host_management.sh@40 -- # nvmftestfini 00:11:55.933 19:18:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:55.933 19:18:42 -- nvmf/common.sh@117 -- # sync 00:11:55.933 19:18:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:55.933 19:18:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:55.933 19:18:42 -- nvmf/common.sh@120 -- # set +e 00:11:55.933 19:18:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:55.933 19:18:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:55.933 rmmod nvme_rdma 00:11:55.933 rmmod nvme_fabrics 00:11:55.933 19:18:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:55.933 19:18:42 -- nvmf/common.sh@124 -- # set -e 00:11:55.933 19:18:42 -- nvmf/common.sh@125 -- # return 0 00:11:55.933 19:18:42 -- nvmf/common.sh@478 -- # '[' -n 2975471 ']' 00:11:55.933 19:18:42 -- nvmf/common.sh@479 -- # killprocess 2975471 00:11:55.933 19:18:42 -- common/autotest_common.sh@936 -- # '[' -z 2975471 ']' 00:11:55.933 19:18:42 -- common/autotest_common.sh@940 -- # kill -0 2975471 00:11:55.933 19:18:42 -- common/autotest_common.sh@941 -- # uname 00:11:55.933 19:18:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:55.933 19:18:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2975471 00:11:55.933 19:18:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:55.933 19:18:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:55.933 19:18:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2975471' 00:11:55.933 killing process with pid 2975471 00:11:55.933 19:18:42 -- common/autotest_common.sh@955 -- # kill 2975471 00:11:55.933 19:18:42 -- common/autotest_common.sh@960 -- # wait 2975471 00:11:56.190 [2024-04-24 19:18:43.022683] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:56.448 [2024-04-24 19:18:43.230708] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:11:56.448 19:18:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:56.448 19:18:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:56.448 00:11:56.448 real 0m5.266s 00:11:56.448 user 0m23.346s 00:11:56.448 sys 0m1.124s 00:11:56.448 19:18:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:56.448 19:18:43 -- common/autotest_common.sh@10 -- # set +x 00:11:56.448 ************************************ 00:11:56.448 END TEST nvmf_host_management 00:11:56.448 ************************************ 00:11:56.448 19:18:43 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:11:56.448 00:11:56.448 real 0m12.147s 00:11:56.448 user 0m25.281s 00:11:56.448 sys 0m6.269s 00:11:56.448 19:18:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:56.448 19:18:43 -- common/autotest_common.sh@10 -- # set +x 00:11:56.448 ************************************ 00:11:56.448 END TEST nvmf_host_management 00:11:56.448 ************************************ 00:11:56.448 19:18:43 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:11:56.448 19:18:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:56.448 19:18:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:56.448 19:18:43 -- common/autotest_common.sh@10 -- # set +x 00:11:56.448 ************************************ 00:11:56.448 START TEST nvmf_lvol 00:11:56.448 ************************************ 00:11:56.448 19:18:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:11:56.707 * Looking for test storage... 00:11:56.707 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:56.707 19:18:43 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:56.707 19:18:43 -- nvmf/common.sh@7 -- # uname -s 00:11:56.707 19:18:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.707 19:18:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.707 19:18:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.707 19:18:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.707 19:18:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.707 19:18:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.707 19:18:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.708 19:18:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.708 19:18:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.708 19:18:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.708 19:18:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:11:56.708 19:18:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:11:56.708 19:18:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.708 19:18:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.708 19:18:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:56.708 19:18:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:56.708 19:18:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:56.708 19:18:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.708 19:18:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.708 19:18:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.708 19:18:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.708 19:18:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.708 19:18:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.708 19:18:43 -- paths/export.sh@5 -- # export PATH 00:11:56.708 19:18:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.708 19:18:43 -- nvmf/common.sh@47 -- # : 0 00:11:56.708 19:18:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:56.708 19:18:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:56.708 19:18:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:56.708 19:18:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.708 19:18:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.708 19:18:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:56.708 19:18:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:56.708 19:18:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:56.708 19:18:43 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:11:56.708 19:18:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:56.708 19:18:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.708 19:18:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:56.708 19:18:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:56.708 19:18:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:56.708 19:18:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.708 19:18:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.708 19:18:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.708 19:18:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:56.708 19:18:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:56.708 19:18:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:56.708 19:18:43 -- common/autotest_common.sh@10 -- # set +x 00:12:03.270 19:18:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:03.270 19:18:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:03.270 19:18:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:03.270 19:18:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:03.270 19:18:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:03.270 19:18:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:03.270 19:18:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:03.270 19:18:49 -- nvmf/common.sh@295 -- # net_devs=() 00:12:03.270 19:18:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:03.270 19:18:49 -- nvmf/common.sh@296 -- # e810=() 00:12:03.270 19:18:49 -- nvmf/common.sh@296 -- # local -ga e810 00:12:03.270 19:18:49 -- nvmf/common.sh@297 -- # x722=() 00:12:03.270 19:18:49 -- nvmf/common.sh@297 -- # local -ga x722 00:12:03.270 19:18:49 -- nvmf/common.sh@298 -- # mlx=() 00:12:03.270 19:18:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:03.270 19:18:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:03.270 19:18:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:03.270 19:18:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:03.270 19:18:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:03.270 19:18:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:03.270 19:18:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:03.271 19:18:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:03.271 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:03.271 19:18:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:03.271 19:18:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:03.271 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:03.271 19:18:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:03.271 19:18:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:03.271 19:18:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:03.271 19:18:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:03.271 Found net devices under 0000:18:00.0: mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:03.271 19:18:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:03.271 19:18:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:03.271 Found net devices under 0000:18:00.1: mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:03.271 19:18:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:03.271 19:18:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:03.271 19:18:49 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:03.271 19:18:49 -- nvmf/common.sh@58 -- # uname 00:12:03.271 19:18:49 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:03.271 19:18:49 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:03.271 19:18:49 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:03.271 19:18:49 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:03.271 19:18:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:03.271 19:18:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:03.271 19:18:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:03.271 19:18:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:03.271 19:18:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:03.271 19:18:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:03.271 19:18:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:03.271 19:18:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:03.271 19:18:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:03.271 19:18:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:03.271 19:18:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:03.271 19:18:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@105 -- # continue 2 00:12:03.271 19:18:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@105 -- # continue 2 00:12:03.271 19:18:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:03.271 19:18:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:03.271 19:18:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:03.271 19:18:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:03.271 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:03.271 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:12:03.271 altname enp24s0f0np0 00:12:03.271 altname ens785f0np0 00:12:03.271 inet 192.168.100.8/24 scope global mlx_0_0 00:12:03.271 valid_lft forever preferred_lft forever 00:12:03.271 19:18:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:03.271 19:18:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:03.271 19:18:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:03.271 19:18:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:03.271 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:03.271 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:12:03.271 altname enp24s0f1np1 00:12:03.271 altname ens785f1np1 00:12:03.271 inet 192.168.100.9/24 scope global mlx_0_1 00:12:03.271 valid_lft forever preferred_lft forever 00:12:03.271 19:18:49 -- nvmf/common.sh@411 -- # return 0 00:12:03.271 19:18:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:03.271 19:18:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:03.271 19:18:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:03.271 19:18:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:03.271 19:18:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:03.271 19:18:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:03.271 19:18:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:03.271 19:18:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:03.271 19:18:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:03.271 19:18:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@105 -- # continue 2 00:12:03.271 19:18:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:03.271 19:18:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:03.271 19:18:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@105 -- # continue 2 00:12:03.271 19:18:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:03.271 19:18:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:03.271 19:18:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:03.271 19:18:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:03.271 19:18:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:03.271 19:18:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:03.271 192.168.100.9' 00:12:03.271 19:18:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:03.271 192.168.100.9' 00:12:03.271 19:18:49 -- nvmf/common.sh@446 -- # head -n 1 00:12:03.271 19:18:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:03.271 19:18:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:03.271 192.168.100.9' 00:12:03.271 19:18:49 -- nvmf/common.sh@447 -- # tail -n +2 00:12:03.271 19:18:49 -- nvmf/common.sh@447 -- # head -n 1 00:12:03.271 19:18:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:03.271 19:18:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:03.272 19:18:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:03.272 19:18:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:03.272 19:18:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:03.272 19:18:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:03.272 19:18:49 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:12:03.272 19:18:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:03.272 19:18:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:03.272 19:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:03.272 19:18:49 -- nvmf/common.sh@470 -- # nvmfpid=2979079 00:12:03.272 19:18:49 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:12:03.272 19:18:49 -- nvmf/common.sh@471 -- # waitforlisten 2979079 00:12:03.272 19:18:49 -- common/autotest_common.sh@817 -- # '[' -z 2979079 ']' 00:12:03.272 19:18:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:03.272 19:18:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:03.272 19:18:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:03.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:03.272 19:18:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:03.272 19:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:03.272 [2024-04-24 19:18:49.741022] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:12:03.272 [2024-04-24 19:18:49.741084] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:03.272 EAL: No free 2048 kB hugepages reported on node 1 00:12:03.272 [2024-04-24 19:18:49.814075] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:03.272 [2024-04-24 19:18:49.896548] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:03.272 [2024-04-24 19:18:49.896605] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:03.272 [2024-04-24 19:18:49.896614] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:03.272 [2024-04-24 19:18:49.896622] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:03.272 [2024-04-24 19:18:49.896629] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:03.272 [2024-04-24 19:18:49.896744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:03.272 [2024-04-24 19:18:49.896844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:03.272 [2024-04-24 19:18:49.896846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:03.550 19:18:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:03.550 19:18:50 -- common/autotest_common.sh@850 -- # return 0 00:12:03.550 19:18:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:03.550 19:18:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:03.550 19:18:50 -- common/autotest_common.sh@10 -- # set +x 00:12:03.807 19:18:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:03.807 19:18:50 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:03.807 [2024-04-24 19:18:50.766899] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x193b730/0x193fc20) succeed. 00:12:03.808 [2024-04-24 19:18:50.777074] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x193ccd0/0x19812b0) succeed. 00:12:04.065 19:18:50 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:04.333 19:18:51 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:12:04.333 19:18:51 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:04.333 19:18:51 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:12:04.333 19:18:51 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:12:04.612 19:18:51 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:12:04.886 19:18:51 -- target/nvmf_lvol.sh@29 -- # lvs=634e87d9-6db3-4de0-b87c-02b0743614e4 00:12:04.886 19:18:51 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 634e87d9-6db3-4de0-b87c-02b0743614e4 lvol 20 00:12:04.886 19:18:51 -- target/nvmf_lvol.sh@32 -- # lvol=1536a2b6-6818-4b2c-b776-d25101c180c6 00:12:04.886 19:18:51 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:05.144 19:18:52 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1536a2b6-6818-4b2c-b776-d25101c180c6 00:12:05.403 19:18:52 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:05.403 [2024-04-24 19:18:52.389174] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:05.403 19:18:52 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:05.660 19:18:52 -- target/nvmf_lvol.sh@42 -- # perf_pid=2979573 00:12:05.660 19:18:52 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:12:05.660 19:18:52 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:12:05.660 EAL: No free 2048 kB hugepages reported on node 1 00:12:07.038 19:18:53 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 1536a2b6-6818-4b2c-b776-d25101c180c6 MY_SNAPSHOT 00:12:07.038 19:18:53 -- target/nvmf_lvol.sh@47 -- # snapshot=e1e9f671-758c-439d-ae6e-4296ae55b297 00:12:07.038 19:18:53 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 1536a2b6-6818-4b2c-b776-d25101c180c6 30 00:12:07.038 19:18:54 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone e1e9f671-758c-439d-ae6e-4296ae55b297 MY_CLONE 00:12:07.297 19:18:54 -- target/nvmf_lvol.sh@49 -- # clone=869b65dd-8509-4d81-b487-b2152d305d13 00:12:07.297 19:18:54 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 869b65dd-8509-4d81-b487-b2152d305d13 00:12:07.555 19:18:54 -- target/nvmf_lvol.sh@53 -- # wait 2979573 00:12:17.531 Initializing NVMe Controllers 00:12:17.531 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:12:17.531 Controller IO queue size 128, less than required. 00:12:17.531 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:17.531 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:12:17.531 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:12:17.531 Initialization complete. Launching workers. 00:12:17.531 ======================================================== 00:12:17.531 Latency(us) 00:12:17.531 Device Information : IOPS MiB/s Average min max 00:12:17.531 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 16765.60 65.49 7636.82 2463.25 49689.13 00:12:17.531 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 16691.80 65.20 7670.37 3597.59 40273.01 00:12:17.531 ======================================================== 00:12:17.531 Total : 33457.40 130.69 7653.55 2463.25 49689.13 00:12:17.531 00:12:17.531 19:19:04 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:17.531 19:19:04 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1536a2b6-6818-4b2c-b776-d25101c180c6 00:12:17.531 19:19:04 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 634e87d9-6db3-4de0-b87c-02b0743614e4 00:12:17.790 19:19:04 -- target/nvmf_lvol.sh@60 -- # rm -f 00:12:17.790 19:19:04 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:12:17.790 19:19:04 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:12:17.790 19:19:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:17.790 19:19:04 -- nvmf/common.sh@117 -- # sync 00:12:17.790 19:19:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:17.790 19:19:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:17.790 19:19:04 -- nvmf/common.sh@120 -- # set +e 00:12:17.790 19:19:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:17.790 19:19:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:17.790 rmmod nvme_rdma 00:12:17.790 rmmod nvme_fabrics 00:12:17.790 19:19:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:17.790 19:19:04 -- nvmf/common.sh@124 -- # set -e 00:12:17.790 19:19:04 -- nvmf/common.sh@125 -- # return 0 00:12:17.790 19:19:04 -- nvmf/common.sh@478 -- # '[' -n 2979079 ']' 00:12:17.790 19:19:04 -- nvmf/common.sh@479 -- # killprocess 2979079 00:12:17.790 19:19:04 -- common/autotest_common.sh@936 -- # '[' -z 2979079 ']' 00:12:17.790 19:19:04 -- common/autotest_common.sh@940 -- # kill -0 2979079 00:12:17.790 19:19:04 -- common/autotest_common.sh@941 -- # uname 00:12:17.790 19:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:17.790 19:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2979079 00:12:17.790 19:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:17.790 19:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:17.790 19:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2979079' 00:12:17.790 killing process with pid 2979079 00:12:17.790 19:19:04 -- common/autotest_common.sh@955 -- # kill 2979079 00:12:17.790 19:19:04 -- common/autotest_common.sh@960 -- # wait 2979079 00:12:17.790 [2024-04-24 19:19:04.739339] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:18.049 19:19:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:18.049 19:19:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:18.049 00:12:18.049 real 0m21.529s 00:12:18.049 user 1m11.489s 00:12:18.049 sys 0m5.889s 00:12:18.049 19:19:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:18.049 19:19:04 -- common/autotest_common.sh@10 -- # set +x 00:12:18.049 ************************************ 00:12:18.049 END TEST nvmf_lvol 00:12:18.049 ************************************ 00:12:18.049 19:19:05 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:12:18.049 19:19:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:18.049 19:19:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:18.049 19:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:18.308 ************************************ 00:12:18.308 START TEST nvmf_lvs_grow 00:12:18.308 ************************************ 00:12:18.308 19:19:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:12:18.308 * Looking for test storage... 00:12:18.308 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:18.308 19:19:05 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:18.308 19:19:05 -- nvmf/common.sh@7 -- # uname -s 00:12:18.308 19:19:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:18.308 19:19:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:18.308 19:19:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:18.308 19:19:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:18.308 19:19:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:18.308 19:19:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:18.308 19:19:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:18.308 19:19:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:18.308 19:19:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:18.308 19:19:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:18.308 19:19:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:12:18.308 19:19:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:12:18.308 19:19:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:18.308 19:19:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:18.308 19:19:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:18.308 19:19:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:18.308 19:19:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:18.308 19:19:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:18.308 19:19:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:18.308 19:19:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:18.308 19:19:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:18.308 19:19:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:18.308 19:19:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:18.308 19:19:05 -- paths/export.sh@5 -- # export PATH 00:12:18.308 19:19:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:18.308 19:19:05 -- nvmf/common.sh@47 -- # : 0 00:12:18.308 19:19:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:18.308 19:19:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:18.308 19:19:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:18.308 19:19:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:18.308 19:19:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:18.308 19:19:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:18.308 19:19:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:18.308 19:19:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:18.308 19:19:05 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:18.308 19:19:05 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:18.308 19:19:05 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:12:18.308 19:19:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:18.308 19:19:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:18.308 19:19:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:18.308 19:19:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:18.308 19:19:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:18.308 19:19:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:18.308 19:19:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:18.308 19:19:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:18.308 19:19:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:18.308 19:19:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:18.308 19:19:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:18.308 19:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:24.875 19:19:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:24.875 19:19:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:24.875 19:19:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:24.875 19:19:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:24.875 19:19:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:24.875 19:19:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:24.875 19:19:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:24.875 19:19:11 -- nvmf/common.sh@295 -- # net_devs=() 00:12:24.875 19:19:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:24.875 19:19:11 -- nvmf/common.sh@296 -- # e810=() 00:12:24.875 19:19:11 -- nvmf/common.sh@296 -- # local -ga e810 00:12:24.875 19:19:11 -- nvmf/common.sh@297 -- # x722=() 00:12:24.875 19:19:11 -- nvmf/common.sh@297 -- # local -ga x722 00:12:24.875 19:19:11 -- nvmf/common.sh@298 -- # mlx=() 00:12:24.875 19:19:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:24.875 19:19:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.875 19:19:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:24.875 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:24.875 19:19:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:24.875 19:19:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:24.875 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:24.875 19:19:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:24.875 19:19:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.875 19:19:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.875 19:19:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:24.875 Found net devices under 0000:18:00.0: mlx_0_0 00:12:24.875 19:19:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.875 19:19:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.875 19:19:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:24.875 Found net devices under 0000:18:00.1: mlx_0_1 00:12:24.875 19:19:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.875 19:19:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:24.875 19:19:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:24.875 19:19:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:24.875 19:19:11 -- nvmf/common.sh@58 -- # uname 00:12:24.875 19:19:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:24.875 19:19:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:24.875 19:19:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:24.875 19:19:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:24.875 19:19:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:24.875 19:19:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:24.875 19:19:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:24.875 19:19:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:24.875 19:19:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:24.875 19:19:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:24.875 19:19:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:24.875 19:19:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:24.875 19:19:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:24.875 19:19:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:24.875 19:19:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:24.875 19:19:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:24.875 19:19:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.875 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:24.875 19:19:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:24.875 19:19:11 -- nvmf/common.sh@105 -- # continue 2 00:12:24.875 19:19:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@105 -- # continue 2 00:12:24.876 19:19:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:24.876 19:19:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:24.876 19:19:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:24.876 19:19:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:24.876 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:24.876 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:12:24.876 altname enp24s0f0np0 00:12:24.876 altname ens785f0np0 00:12:24.876 inet 192.168.100.8/24 scope global mlx_0_0 00:12:24.876 valid_lft forever preferred_lft forever 00:12:24.876 19:19:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:24.876 19:19:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:24.876 19:19:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:24.876 19:19:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:24.876 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:24.876 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:12:24.876 altname enp24s0f1np1 00:12:24.876 altname ens785f1np1 00:12:24.876 inet 192.168.100.9/24 scope global mlx_0_1 00:12:24.876 valid_lft forever preferred_lft forever 00:12:24.876 19:19:11 -- nvmf/common.sh@411 -- # return 0 00:12:24.876 19:19:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:24.876 19:19:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:24.876 19:19:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:24.876 19:19:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:24.876 19:19:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:24.876 19:19:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:24.876 19:19:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:24.876 19:19:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:24.876 19:19:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:24.876 19:19:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@105 -- # continue 2 00:12:24.876 19:19:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:24.876 19:19:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:24.876 19:19:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@105 -- # continue 2 00:12:24.876 19:19:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:24.876 19:19:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:24.876 19:19:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:24.876 19:19:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:24.876 19:19:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:24.876 19:19:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:24.876 192.168.100.9' 00:12:24.876 19:19:11 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:24.876 192.168.100.9' 00:12:24.876 19:19:11 -- nvmf/common.sh@446 -- # head -n 1 00:12:24.876 19:19:11 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:24.876 19:19:11 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:24.876 192.168.100.9' 00:12:24.876 19:19:11 -- nvmf/common.sh@447 -- # tail -n +2 00:12:24.876 19:19:11 -- nvmf/common.sh@447 -- # head -n 1 00:12:24.876 19:19:11 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:24.876 19:19:11 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:24.876 19:19:11 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:24.876 19:19:11 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:24.876 19:19:11 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:24.876 19:19:11 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:24.876 19:19:11 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:12:24.876 19:19:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:24.876 19:19:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:24.876 19:19:11 -- common/autotest_common.sh@10 -- # set +x 00:12:24.876 19:19:11 -- nvmf/common.sh@470 -- # nvmfpid=2984038 00:12:24.876 19:19:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:24.876 19:19:11 -- nvmf/common.sh@471 -- # waitforlisten 2984038 00:12:24.876 19:19:11 -- common/autotest_common.sh@817 -- # '[' -z 2984038 ']' 00:12:24.876 19:19:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.876 19:19:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:24.876 19:19:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.876 19:19:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:24.876 19:19:11 -- common/autotest_common.sh@10 -- # set +x 00:12:24.876 [2024-04-24 19:19:11.570246] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:12:24.876 [2024-04-24 19:19:11.570308] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.876 EAL: No free 2048 kB hugepages reported on node 1 00:12:24.876 [2024-04-24 19:19:11.643145] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:24.876 [2024-04-24 19:19:11.725991] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.876 [2024-04-24 19:19:11.726036] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.876 [2024-04-24 19:19:11.726045] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:24.876 [2024-04-24 19:19:11.726069] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:24.876 [2024-04-24 19:19:11.726076] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.876 [2024-04-24 19:19:11.726104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:25.442 19:19:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:25.442 19:19:12 -- common/autotest_common.sh@850 -- # return 0 00:12:25.442 19:19:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:25.442 19:19:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:25.442 19:19:12 -- common/autotest_common.sh@10 -- # set +x 00:12:25.442 19:19:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:25.442 19:19:12 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:25.701 [2024-04-24 19:19:12.599588] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x7730e0/0x7775d0) succeed. 00:12:25.701 [2024-04-24 19:19:12.608816] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x7745e0/0x7b8c60) succeed. 00:12:25.701 19:19:12 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:12:25.701 19:19:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:12:25.701 19:19:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:25.701 19:19:12 -- common/autotest_common.sh@10 -- # set +x 00:12:25.960 ************************************ 00:12:25.960 START TEST lvs_grow_clean 00:12:25.960 ************************************ 00:12:25.960 19:19:12 -- common/autotest_common.sh@1111 -- # lvs_grow 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:25.960 19:19:12 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:26.218 19:19:13 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:26.218 19:19:13 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:26.218 19:19:13 -- target/nvmf_lvs_grow.sh@28 -- # lvs=3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:26.218 19:19:13 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:26.218 19:19:13 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:26.477 19:19:13 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:26.477 19:19:13 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:26.477 19:19:13 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 lvol 150 00:12:26.735 19:19:13 -- target/nvmf_lvs_grow.sh@33 -- # lvol=642160db-fd60-4e50-a20b-c53784f11dfa 00:12:26.735 19:19:13 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:26.735 19:19:13 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:26.993 [2024-04-24 19:19:13.763389] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:26.993 [2024-04-24 19:19:13.763459] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:26.993 true 00:12:26.993 19:19:13 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:26.993 19:19:13 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:26.993 19:19:13 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:26.993 19:19:13 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:27.252 19:19:14 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 642160db-fd60-4e50-a20b-c53784f11dfa 00:12:27.509 19:19:14 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:27.509 [2024-04-24 19:19:14.441607] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:27.509 19:19:14 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:27.767 19:19:14 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2984533 00:12:27.767 19:19:14 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:27.767 19:19:14 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:27.767 19:19:14 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2984533 /var/tmp/bdevperf.sock 00:12:27.767 19:19:14 -- common/autotest_common.sh@817 -- # '[' -z 2984533 ']' 00:12:27.767 19:19:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:27.767 19:19:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:27.767 19:19:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:27.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:27.767 19:19:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:27.767 19:19:14 -- common/autotest_common.sh@10 -- # set +x 00:12:27.768 [2024-04-24 19:19:14.657898] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:12:27.768 [2024-04-24 19:19:14.657963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2984533 ] 00:12:27.768 EAL: No free 2048 kB hugepages reported on node 1 00:12:27.768 [2024-04-24 19:19:14.729836] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:28.026 [2024-04-24 19:19:14.817625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:28.591 19:19:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:28.591 19:19:15 -- common/autotest_common.sh@850 -- # return 0 00:12:28.591 19:19:15 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:28.848 Nvme0n1 00:12:28.848 19:19:15 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:29.106 [ 00:12:29.106 { 00:12:29.106 "name": "Nvme0n1", 00:12:29.106 "aliases": [ 00:12:29.106 "642160db-fd60-4e50-a20b-c53784f11dfa" 00:12:29.106 ], 00:12:29.106 "product_name": "NVMe disk", 00:12:29.106 "block_size": 4096, 00:12:29.106 "num_blocks": 38912, 00:12:29.106 "uuid": "642160db-fd60-4e50-a20b-c53784f11dfa", 00:12:29.106 "assigned_rate_limits": { 00:12:29.106 "rw_ios_per_sec": 0, 00:12:29.106 "rw_mbytes_per_sec": 0, 00:12:29.106 "r_mbytes_per_sec": 0, 00:12:29.106 "w_mbytes_per_sec": 0 00:12:29.106 }, 00:12:29.106 "claimed": false, 00:12:29.106 "zoned": false, 00:12:29.106 "supported_io_types": { 00:12:29.106 "read": true, 00:12:29.106 "write": true, 00:12:29.106 "unmap": true, 00:12:29.106 "write_zeroes": true, 00:12:29.106 "flush": true, 00:12:29.106 "reset": true, 00:12:29.106 "compare": true, 00:12:29.106 "compare_and_write": true, 00:12:29.106 "abort": true, 00:12:29.106 "nvme_admin": true, 00:12:29.106 "nvme_io": true 00:12:29.106 }, 00:12:29.106 "memory_domains": [ 00:12:29.106 { 00:12:29.106 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:12:29.106 "dma_device_type": 0 00:12:29.106 } 00:12:29.106 ], 00:12:29.106 "driver_specific": { 00:12:29.106 "nvme": [ 00:12:29.106 { 00:12:29.106 "trid": { 00:12:29.106 "trtype": "RDMA", 00:12:29.106 "adrfam": "IPv4", 00:12:29.106 "traddr": "192.168.100.8", 00:12:29.106 "trsvcid": "4420", 00:12:29.106 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:29.106 }, 00:12:29.106 "ctrlr_data": { 00:12:29.106 "cntlid": 1, 00:12:29.106 "vendor_id": "0x8086", 00:12:29.106 "model_number": "SPDK bdev Controller", 00:12:29.106 "serial_number": "SPDK0", 00:12:29.106 "firmware_revision": "24.05", 00:12:29.106 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:29.106 "oacs": { 00:12:29.106 "security": 0, 00:12:29.106 "format": 0, 00:12:29.106 "firmware": 0, 00:12:29.106 "ns_manage": 0 00:12:29.106 }, 00:12:29.106 "multi_ctrlr": true, 00:12:29.106 "ana_reporting": false 00:12:29.106 }, 00:12:29.106 "vs": { 00:12:29.106 "nvme_version": "1.3" 00:12:29.106 }, 00:12:29.106 "ns_data": { 00:12:29.106 "id": 1, 00:12:29.106 "can_share": true 00:12:29.106 } 00:12:29.106 } 00:12:29.106 ], 00:12:29.106 "mp_policy": "active_passive" 00:12:29.106 } 00:12:29.106 } 00:12:29.106 ] 00:12:29.106 19:19:15 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2984722 00:12:29.106 19:19:15 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:29.106 19:19:15 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:29.106 Running I/O for 10 seconds... 00:12:30.039 Latency(us) 00:12:30.039 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:30.039 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:30.039 Nvme0n1 : 1.00 35487.00 138.62 0.00 0.00 0.00 0.00 0.00 00:12:30.039 =================================================================================================================== 00:12:30.039 Total : 35487.00 138.62 0.00 0.00 0.00 0.00 0.00 00:12:30.039 00:12:30.973 19:19:17 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:30.973 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:30.973 Nvme0n1 : 2.00 35743.50 139.62 0.00 0.00 0.00 0.00 0.00 00:12:30.973 =================================================================================================================== 00:12:30.973 Total : 35743.50 139.62 0.00 0.00 0.00 0.00 0.00 00:12:30.973 00:12:31.231 true 00:12:31.231 19:19:18 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:31.231 19:19:18 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:31.488 19:19:18 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:31.488 19:19:18 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:31.488 19:19:18 -- target/nvmf_lvs_grow.sh@65 -- # wait 2984722 00:12:32.050 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:32.050 Nvme0n1 : 3.00 35820.00 139.92 0.00 0.00 0.00 0.00 0.00 00:12:32.050 =================================================================================================================== 00:12:32.050 Total : 35820.00 139.92 0.00 0.00 0.00 0.00 0.00 00:12:32.050 00:12:32.984 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:32.984 Nvme0n1 : 4.00 35913.25 140.29 0.00 0.00 0.00 0.00 0.00 00:12:32.984 =================================================================================================================== 00:12:32.984 Total : 35913.25 140.29 0.00 0.00 0.00 0.00 0.00 00:12:32.984 00:12:34.357 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:34.357 Nvme0n1 : 5.00 35806.80 139.87 0.00 0.00 0.00 0.00 0.00 00:12:34.357 =================================================================================================================== 00:12:34.357 Total : 35806.80 139.87 0.00 0.00 0.00 0.00 0.00 00:12:34.357 00:12:35.291 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:35.291 Nvme0n1 : 6.00 35894.17 140.21 0.00 0.00 0.00 0.00 0.00 00:12:35.291 =================================================================================================================== 00:12:35.291 Total : 35894.17 140.21 0.00 0.00 0.00 0.00 0.00 00:12:35.291 00:12:36.224 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:36.224 Nvme0n1 : 7.00 35959.43 140.47 0.00 0.00 0.00 0.00 0.00 00:12:36.224 =================================================================================================================== 00:12:36.224 Total : 35959.43 140.47 0.00 0.00 0.00 0.00 0.00 00:12:36.224 00:12:37.158 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:37.158 Nvme0n1 : 8.00 35971.25 140.51 0.00 0.00 0.00 0.00 0.00 00:12:37.158 =================================================================================================================== 00:12:37.158 Total : 35971.25 140.51 0.00 0.00 0.00 0.00 0.00 00:12:37.158 00:12:38.091 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:38.091 Nvme0n1 : 9.00 36013.56 140.68 0.00 0.00 0.00 0.00 0.00 00:12:38.091 =================================================================================================================== 00:12:38.091 Total : 36013.56 140.68 0.00 0.00 0.00 0.00 0.00 00:12:38.091 00:12:39.027 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:39.027 Nvme0n1 : 10.00 35986.50 140.57 0.00 0.00 0.00 0.00 0.00 00:12:39.027 =================================================================================================================== 00:12:39.027 Total : 35986.50 140.57 0.00 0.00 0.00 0.00 0.00 00:12:39.027 00:12:39.027 00:12:39.027 Latency(us) 00:12:39.027 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:39.027 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:39.027 Nvme0n1 : 10.00 35986.18 140.57 0.00 0.00 3554.15 2222.53 7978.30 00:12:39.027 =================================================================================================================== 00:12:39.027 Total : 35986.18 140.57 0.00 0.00 3554.15 2222.53 7978.30 00:12:39.027 0 00:12:39.027 19:19:26 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2984533 00:12:39.027 19:19:26 -- common/autotest_common.sh@936 -- # '[' -z 2984533 ']' 00:12:39.027 19:19:26 -- common/autotest_common.sh@940 -- # kill -0 2984533 00:12:39.027 19:19:26 -- common/autotest_common.sh@941 -- # uname 00:12:39.027 19:19:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:39.027 19:19:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2984533 00:12:39.285 19:19:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:39.285 19:19:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:39.285 19:19:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2984533' 00:12:39.285 killing process with pid 2984533 00:12:39.285 19:19:26 -- common/autotest_common.sh@955 -- # kill 2984533 00:12:39.285 Received shutdown signal, test time was about 10.000000 seconds 00:12:39.285 00:12:39.285 Latency(us) 00:12:39.285 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:39.285 =================================================================================================================== 00:12:39.285 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:39.285 19:19:26 -- common/autotest_common.sh@960 -- # wait 2984533 00:12:39.542 19:19:26 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:39.542 19:19:26 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:39.542 19:19:26 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:12:39.800 19:19:26 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:12:39.800 19:19:26 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:12:39.800 19:19:26 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:40.058 [2024-04-24 19:19:26.876996] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:40.058 19:19:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:40.058 19:19:26 -- common/autotest_common.sh@638 -- # local es=0 00:12:40.058 19:19:26 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:40.058 19:19:26 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:40.058 19:19:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.058 19:19:26 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:40.058 19:19:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.058 19:19:26 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:40.058 19:19:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:40.058 19:19:26 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:40.058 19:19:26 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:12:40.058 19:19:26 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:40.318 request: 00:12:40.318 { 00:12:40.318 "uuid": "3964cfb8-d3be-4cd9-99e5-3fd09ec79508", 00:12:40.318 "method": "bdev_lvol_get_lvstores", 00:12:40.318 "req_id": 1 00:12:40.318 } 00:12:40.318 Got JSON-RPC error response 00:12:40.318 response: 00:12:40.318 { 00:12:40.318 "code": -19, 00:12:40.318 "message": "No such device" 00:12:40.318 } 00:12:40.318 19:19:27 -- common/autotest_common.sh@641 -- # es=1 00:12:40.318 19:19:27 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:40.318 19:19:27 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:40.318 19:19:27 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:40.318 19:19:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:40.318 aio_bdev 00:12:40.318 19:19:27 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 642160db-fd60-4e50-a20b-c53784f11dfa 00:12:40.318 19:19:27 -- common/autotest_common.sh@885 -- # local bdev_name=642160db-fd60-4e50-a20b-c53784f11dfa 00:12:40.318 19:19:27 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:40.318 19:19:27 -- common/autotest_common.sh@887 -- # local i 00:12:40.318 19:19:27 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:40.318 19:19:27 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:40.318 19:19:27 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:40.606 19:19:27 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 642160db-fd60-4e50-a20b-c53784f11dfa -t 2000 00:12:40.606 [ 00:12:40.606 { 00:12:40.606 "name": "642160db-fd60-4e50-a20b-c53784f11dfa", 00:12:40.606 "aliases": [ 00:12:40.606 "lvs/lvol" 00:12:40.606 ], 00:12:40.606 "product_name": "Logical Volume", 00:12:40.606 "block_size": 4096, 00:12:40.606 "num_blocks": 38912, 00:12:40.606 "uuid": "642160db-fd60-4e50-a20b-c53784f11dfa", 00:12:40.606 "assigned_rate_limits": { 00:12:40.606 "rw_ios_per_sec": 0, 00:12:40.606 "rw_mbytes_per_sec": 0, 00:12:40.606 "r_mbytes_per_sec": 0, 00:12:40.606 "w_mbytes_per_sec": 0 00:12:40.606 }, 00:12:40.606 "claimed": false, 00:12:40.606 "zoned": false, 00:12:40.606 "supported_io_types": { 00:12:40.606 "read": true, 00:12:40.606 "write": true, 00:12:40.606 "unmap": true, 00:12:40.606 "write_zeroes": true, 00:12:40.606 "flush": false, 00:12:40.606 "reset": true, 00:12:40.606 "compare": false, 00:12:40.606 "compare_and_write": false, 00:12:40.606 "abort": false, 00:12:40.606 "nvme_admin": false, 00:12:40.606 "nvme_io": false 00:12:40.606 }, 00:12:40.606 "driver_specific": { 00:12:40.606 "lvol": { 00:12:40.606 "lvol_store_uuid": "3964cfb8-d3be-4cd9-99e5-3fd09ec79508", 00:12:40.606 "base_bdev": "aio_bdev", 00:12:40.606 "thin_provision": false, 00:12:40.606 "snapshot": false, 00:12:40.606 "clone": false, 00:12:40.606 "esnap_clone": false 00:12:40.606 } 00:12:40.606 } 00:12:40.606 } 00:12:40.606 ] 00:12:40.881 19:19:27 -- common/autotest_common.sh@893 -- # return 0 00:12:40.881 19:19:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:40.881 19:19:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:12:40.881 19:19:27 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:12:40.881 19:19:27 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:40.881 19:19:27 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:12:41.140 19:19:27 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:12:41.140 19:19:27 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 642160db-fd60-4e50-a20b-c53784f11dfa 00:12:41.140 19:19:28 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3964cfb8-d3be-4cd9-99e5-3fd09ec79508 00:12:41.398 19:19:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:41.657 19:19:28 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:41.657 00:12:41.657 real 0m15.694s 00:12:41.657 user 0m15.572s 00:12:41.657 sys 0m1.252s 00:12:41.657 19:19:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:41.657 19:19:28 -- common/autotest_common.sh@10 -- # set +x 00:12:41.657 ************************************ 00:12:41.657 END TEST lvs_grow_clean 00:12:41.657 ************************************ 00:12:41.657 19:19:28 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:12:41.657 19:19:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:41.657 19:19:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:41.657 19:19:28 -- common/autotest_common.sh@10 -- # set +x 00:12:41.915 ************************************ 00:12:41.915 START TEST lvs_grow_dirty 00:12:41.915 ************************************ 00:12:41.915 19:19:28 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:41.915 19:19:28 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:42.173 19:19:28 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:42.173 19:19:28 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:42.173 19:19:29 -- target/nvmf_lvs_grow.sh@28 -- # lvs=6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:42.173 19:19:29 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:42.173 19:19:29 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:42.431 19:19:29 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:42.431 19:19:29 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:42.431 19:19:29 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 lvol 150 00:12:42.689 19:19:29 -- target/nvmf_lvs_grow.sh@33 -- # lvol=563e4892-5383-48a6-8674-b7846343c2e7 00:12:42.689 19:19:29 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:42.689 19:19:29 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:42.689 [2024-04-24 19:19:29.624353] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:42.689 [2024-04-24 19:19:29.624416] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:42.689 true 00:12:42.689 19:19:29 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:42.689 19:19:29 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:42.947 19:19:29 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:42.947 19:19:29 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:42.947 19:19:29 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 563e4892-5383-48a6-8674-b7846343c2e7 00:12:43.205 19:19:30 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:43.463 19:19:30 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:43.721 19:19:30 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:43.721 19:19:30 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2986667 00:12:43.721 19:19:30 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:43.721 19:19:30 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2986667 /var/tmp/bdevperf.sock 00:12:43.721 19:19:30 -- common/autotest_common.sh@817 -- # '[' -z 2986667 ']' 00:12:43.722 19:19:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:43.722 19:19:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:43.722 19:19:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:43.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:43.722 19:19:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:43.722 19:19:30 -- common/autotest_common.sh@10 -- # set +x 00:12:43.722 [2024-04-24 19:19:30.532394] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:12:43.722 [2024-04-24 19:19:30.532449] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2986667 ] 00:12:43.722 EAL: No free 2048 kB hugepages reported on node 1 00:12:43.722 [2024-04-24 19:19:30.603713] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:43.722 [2024-04-24 19:19:30.690604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:44.656 19:19:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:44.656 19:19:31 -- common/autotest_common.sh@850 -- # return 0 00:12:44.656 19:19:31 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:44.656 Nvme0n1 00:12:44.656 19:19:31 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:44.914 [ 00:12:44.914 { 00:12:44.914 "name": "Nvme0n1", 00:12:44.914 "aliases": [ 00:12:44.914 "563e4892-5383-48a6-8674-b7846343c2e7" 00:12:44.914 ], 00:12:44.914 "product_name": "NVMe disk", 00:12:44.914 "block_size": 4096, 00:12:44.914 "num_blocks": 38912, 00:12:44.914 "uuid": "563e4892-5383-48a6-8674-b7846343c2e7", 00:12:44.914 "assigned_rate_limits": { 00:12:44.914 "rw_ios_per_sec": 0, 00:12:44.914 "rw_mbytes_per_sec": 0, 00:12:44.914 "r_mbytes_per_sec": 0, 00:12:44.914 "w_mbytes_per_sec": 0 00:12:44.914 }, 00:12:44.914 "claimed": false, 00:12:44.914 "zoned": false, 00:12:44.914 "supported_io_types": { 00:12:44.914 "read": true, 00:12:44.914 "write": true, 00:12:44.914 "unmap": true, 00:12:44.914 "write_zeroes": true, 00:12:44.914 "flush": true, 00:12:44.914 "reset": true, 00:12:44.914 "compare": true, 00:12:44.914 "compare_and_write": true, 00:12:44.914 "abort": true, 00:12:44.914 "nvme_admin": true, 00:12:44.914 "nvme_io": true 00:12:44.914 }, 00:12:44.914 "memory_domains": [ 00:12:44.914 { 00:12:44.914 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:12:44.914 "dma_device_type": 0 00:12:44.914 } 00:12:44.914 ], 00:12:44.914 "driver_specific": { 00:12:44.914 "nvme": [ 00:12:44.914 { 00:12:44.914 "trid": { 00:12:44.914 "trtype": "RDMA", 00:12:44.914 "adrfam": "IPv4", 00:12:44.914 "traddr": "192.168.100.8", 00:12:44.914 "trsvcid": "4420", 00:12:44.914 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:44.914 }, 00:12:44.914 "ctrlr_data": { 00:12:44.914 "cntlid": 1, 00:12:44.914 "vendor_id": "0x8086", 00:12:44.914 "model_number": "SPDK bdev Controller", 00:12:44.914 "serial_number": "SPDK0", 00:12:44.914 "firmware_revision": "24.05", 00:12:44.914 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:44.914 "oacs": { 00:12:44.914 "security": 0, 00:12:44.914 "format": 0, 00:12:44.914 "firmware": 0, 00:12:44.914 "ns_manage": 0 00:12:44.914 }, 00:12:44.914 "multi_ctrlr": true, 00:12:44.914 "ana_reporting": false 00:12:44.914 }, 00:12:44.914 "vs": { 00:12:44.914 "nvme_version": "1.3" 00:12:44.914 }, 00:12:44.914 "ns_data": { 00:12:44.914 "id": 1, 00:12:44.914 "can_share": true 00:12:44.914 } 00:12:44.914 } 00:12:44.914 ], 00:12:44.914 "mp_policy": "active_passive" 00:12:44.914 } 00:12:44.914 } 00:12:44.914 ] 00:12:44.914 19:19:31 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2986831 00:12:44.914 19:19:31 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:44.914 19:19:31 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:44.914 Running I/O for 10 seconds... 00:12:46.290 Latency(us) 00:12:46.290 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:46.290 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:46.290 Nvme0n1 : 1.00 35257.00 137.72 0.00 0.00 0.00 0.00 0.00 00:12:46.290 =================================================================================================================== 00:12:46.290 Total : 35257.00 137.72 0.00 0.00 0.00 0.00 0.00 00:12:46.290 00:12:46.864 19:19:33 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:47.124 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:47.124 Nvme0n1 : 2.00 35564.50 138.92 0.00 0.00 0.00 0.00 0.00 00:12:47.124 =================================================================================================================== 00:12:47.124 Total : 35564.50 138.92 0.00 0.00 0.00 0.00 0.00 00:12:47.124 00:12:47.124 true 00:12:47.124 19:19:34 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:47.124 19:19:34 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:47.383 19:19:34 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:47.383 19:19:34 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:47.383 19:19:34 -- target/nvmf_lvs_grow.sh@65 -- # wait 2986831 00:12:47.951 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:47.951 Nvme0n1 : 3.00 35677.67 139.37 0.00 0.00 0.00 0.00 0.00 00:12:47.951 =================================================================================================================== 00:12:47.951 Total : 35677.67 139.37 0.00 0.00 0.00 0.00 0.00 00:12:47.951 00:12:49.329 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:49.329 Nvme0n1 : 4.00 35822.25 139.93 0.00 0.00 0.00 0.00 0.00 00:12:49.329 =================================================================================================================== 00:12:49.329 Total : 35822.25 139.93 0.00 0.00 0.00 0.00 0.00 00:12:49.329 00:12:49.896 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:49.896 Nvme0n1 : 5.00 35890.00 140.20 0.00 0.00 0.00 0.00 0.00 00:12:49.896 =================================================================================================================== 00:12:49.896 Total : 35890.00 140.20 0.00 0.00 0.00 0.00 0.00 00:12:49.896 00:12:51.273 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:51.273 Nvme0n1 : 6.00 35956.33 140.45 0.00 0.00 0.00 0.00 0.00 00:12:51.273 =================================================================================================================== 00:12:51.273 Total : 35956.33 140.45 0.00 0.00 0.00 0.00 0.00 00:12:51.273 00:12:52.211 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:52.211 Nvme0n1 : 7.00 36008.00 140.66 0.00 0.00 0.00 0.00 0.00 00:12:52.211 =================================================================================================================== 00:12:52.211 Total : 36008.00 140.66 0.00 0.00 0.00 0.00 0.00 00:12:52.211 00:12:53.148 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:53.148 Nvme0n1 : 8.00 36040.75 140.78 0.00 0.00 0.00 0.00 0.00 00:12:53.148 =================================================================================================================== 00:12:53.148 Total : 36040.75 140.78 0.00 0.00 0.00 0.00 0.00 00:12:53.148 00:12:54.086 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:54.086 Nvme0n1 : 9.00 36010.00 140.66 0.00 0.00 0.00 0.00 0.00 00:12:54.086 =================================================================================================================== 00:12:54.086 Total : 36010.00 140.66 0.00 0.00 0.00 0.00 0.00 00:12:54.086 00:12:55.024 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:55.024 Nvme0n1 : 10.00 36038.80 140.78 0.00 0.00 0.00 0.00 0.00 00:12:55.024 =================================================================================================================== 00:12:55.024 Total : 36038.80 140.78 0.00 0.00 0.00 0.00 0.00 00:12:55.024 00:12:55.024 00:12:55.024 Latency(us) 00:12:55.024 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:55.024 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:55.024 Nvme0n1 : 10.00 36040.46 140.78 0.00 0.00 3548.77 2236.77 14132.98 00:12:55.024 =================================================================================================================== 00:12:55.024 Total : 36040.46 140.78 0.00 0.00 3548.77 2236.77 14132.98 00:12:55.024 0 00:12:55.024 19:19:41 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2986667 00:12:55.024 19:19:41 -- common/autotest_common.sh@936 -- # '[' -z 2986667 ']' 00:12:55.024 19:19:41 -- common/autotest_common.sh@940 -- # kill -0 2986667 00:12:55.024 19:19:41 -- common/autotest_common.sh@941 -- # uname 00:12:55.024 19:19:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:55.024 19:19:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2986667 00:12:55.024 19:19:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:55.024 19:19:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:55.024 19:19:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2986667' 00:12:55.024 killing process with pid 2986667 00:12:55.024 19:19:42 -- common/autotest_common.sh@955 -- # kill 2986667 00:12:55.024 Received shutdown signal, test time was about 10.000000 seconds 00:12:55.024 00:12:55.024 Latency(us) 00:12:55.024 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:55.024 =================================================================================================================== 00:12:55.024 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:55.024 19:19:42 -- common/autotest_common.sh@960 -- # wait 2986667 00:12:55.284 19:19:42 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:55.543 19:19:42 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:55.543 19:19:42 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2984038 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@74 -- # wait 2984038 00:12:55.802 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2984038 Killed "${NVMF_APP[@]}" "$@" 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@74 -- # true 00:12:55.802 19:19:42 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:12:55.802 19:19:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:55.802 19:19:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:55.802 19:19:42 -- common/autotest_common.sh@10 -- # set +x 00:12:55.802 19:19:42 -- nvmf/common.sh@470 -- # nvmfpid=2988263 00:12:55.802 19:19:42 -- nvmf/common.sh@471 -- # waitforlisten 2988263 00:12:55.802 19:19:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:55.802 19:19:42 -- common/autotest_common.sh@817 -- # '[' -z 2988263 ']' 00:12:55.802 19:19:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.802 19:19:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:55.802 19:19:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.802 19:19:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:55.802 19:19:42 -- common/autotest_common.sh@10 -- # set +x 00:12:55.802 [2024-04-24 19:19:42.703277] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:12:55.802 [2024-04-24 19:19:42.703332] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.802 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.802 [2024-04-24 19:19:42.778462] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:56.061 [2024-04-24 19:19:42.874606] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:56.061 [2024-04-24 19:19:42.874643] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:56.061 [2024-04-24 19:19:42.874653] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:56.061 [2024-04-24 19:19:42.874661] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:56.061 [2024-04-24 19:19:42.874669] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:56.061 [2024-04-24 19:19:42.874697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:56.630 19:19:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:56.630 19:19:43 -- common/autotest_common.sh@850 -- # return 0 00:12:56.630 19:19:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:56.630 19:19:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:56.630 19:19:43 -- common/autotest_common.sh@10 -- # set +x 00:12:56.630 19:19:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.630 19:19:43 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:56.889 [2024-04-24 19:19:43.727762] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:12:56.889 [2024-04-24 19:19:43.727834] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:12:56.889 [2024-04-24 19:19:43.727859] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:12:56.889 19:19:43 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:12:56.889 19:19:43 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 563e4892-5383-48a6-8674-b7846343c2e7 00:12:56.889 19:19:43 -- common/autotest_common.sh@885 -- # local bdev_name=563e4892-5383-48a6-8674-b7846343c2e7 00:12:56.889 19:19:43 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:56.889 19:19:43 -- common/autotest_common.sh@887 -- # local i 00:12:56.889 19:19:43 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:56.889 19:19:43 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:56.889 19:19:43 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:57.148 19:19:43 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 563e4892-5383-48a6-8674-b7846343c2e7 -t 2000 00:12:57.148 [ 00:12:57.148 { 00:12:57.148 "name": "563e4892-5383-48a6-8674-b7846343c2e7", 00:12:57.148 "aliases": [ 00:12:57.148 "lvs/lvol" 00:12:57.148 ], 00:12:57.148 "product_name": "Logical Volume", 00:12:57.148 "block_size": 4096, 00:12:57.148 "num_blocks": 38912, 00:12:57.148 "uuid": "563e4892-5383-48a6-8674-b7846343c2e7", 00:12:57.148 "assigned_rate_limits": { 00:12:57.148 "rw_ios_per_sec": 0, 00:12:57.148 "rw_mbytes_per_sec": 0, 00:12:57.148 "r_mbytes_per_sec": 0, 00:12:57.148 "w_mbytes_per_sec": 0 00:12:57.148 }, 00:12:57.148 "claimed": false, 00:12:57.148 "zoned": false, 00:12:57.148 "supported_io_types": { 00:12:57.148 "read": true, 00:12:57.148 "write": true, 00:12:57.148 "unmap": true, 00:12:57.148 "write_zeroes": true, 00:12:57.148 "flush": false, 00:12:57.148 "reset": true, 00:12:57.148 "compare": false, 00:12:57.148 "compare_and_write": false, 00:12:57.148 "abort": false, 00:12:57.148 "nvme_admin": false, 00:12:57.148 "nvme_io": false 00:12:57.148 }, 00:12:57.148 "driver_specific": { 00:12:57.148 "lvol": { 00:12:57.148 "lvol_store_uuid": "6c55e149-f93e-4990-9de5-ebf21987c4e3", 00:12:57.148 "base_bdev": "aio_bdev", 00:12:57.148 "thin_provision": false, 00:12:57.148 "snapshot": false, 00:12:57.148 "clone": false, 00:12:57.148 "esnap_clone": false 00:12:57.148 } 00:12:57.148 } 00:12:57.148 } 00:12:57.148 ] 00:12:57.148 19:19:44 -- common/autotest_common.sh@893 -- # return 0 00:12:57.148 19:19:44 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:57.148 19:19:44 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:12:57.407 19:19:44 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:12:57.407 19:19:44 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:57.407 19:19:44 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:12:57.407 19:19:44 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:12:57.407 19:19:44 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:57.665 [2024-04-24 19:19:44.576049] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:57.665 19:19:44 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:57.665 19:19:44 -- common/autotest_common.sh@638 -- # local es=0 00:12:57.665 19:19:44 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:57.665 19:19:44 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:57.665 19:19:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:57.665 19:19:44 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:57.665 19:19:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:57.665 19:19:44 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:57.665 19:19:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:57.665 19:19:44 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:57.665 19:19:44 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:12:57.665 19:19:44 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:57.923 request: 00:12:57.923 { 00:12:57.923 "uuid": "6c55e149-f93e-4990-9de5-ebf21987c4e3", 00:12:57.923 "method": "bdev_lvol_get_lvstores", 00:12:57.923 "req_id": 1 00:12:57.923 } 00:12:57.923 Got JSON-RPC error response 00:12:57.923 response: 00:12:57.923 { 00:12:57.923 "code": -19, 00:12:57.923 "message": "No such device" 00:12:57.923 } 00:12:57.923 19:19:44 -- common/autotest_common.sh@641 -- # es=1 00:12:57.923 19:19:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:57.923 19:19:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:57.923 19:19:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:57.923 19:19:44 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:58.180 aio_bdev 00:12:58.180 19:19:44 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 563e4892-5383-48a6-8674-b7846343c2e7 00:12:58.180 19:19:44 -- common/autotest_common.sh@885 -- # local bdev_name=563e4892-5383-48a6-8674-b7846343c2e7 00:12:58.180 19:19:44 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:12:58.180 19:19:44 -- common/autotest_common.sh@887 -- # local i 00:12:58.180 19:19:44 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:12:58.180 19:19:44 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:12:58.180 19:19:44 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:58.180 19:19:45 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 563e4892-5383-48a6-8674-b7846343c2e7 -t 2000 00:12:58.503 [ 00:12:58.503 { 00:12:58.503 "name": "563e4892-5383-48a6-8674-b7846343c2e7", 00:12:58.503 "aliases": [ 00:12:58.503 "lvs/lvol" 00:12:58.503 ], 00:12:58.503 "product_name": "Logical Volume", 00:12:58.503 "block_size": 4096, 00:12:58.503 "num_blocks": 38912, 00:12:58.503 "uuid": "563e4892-5383-48a6-8674-b7846343c2e7", 00:12:58.503 "assigned_rate_limits": { 00:12:58.503 "rw_ios_per_sec": 0, 00:12:58.503 "rw_mbytes_per_sec": 0, 00:12:58.503 "r_mbytes_per_sec": 0, 00:12:58.503 "w_mbytes_per_sec": 0 00:12:58.503 }, 00:12:58.503 "claimed": false, 00:12:58.503 "zoned": false, 00:12:58.503 "supported_io_types": { 00:12:58.503 "read": true, 00:12:58.503 "write": true, 00:12:58.503 "unmap": true, 00:12:58.503 "write_zeroes": true, 00:12:58.503 "flush": false, 00:12:58.503 "reset": true, 00:12:58.503 "compare": false, 00:12:58.503 "compare_and_write": false, 00:12:58.503 "abort": false, 00:12:58.503 "nvme_admin": false, 00:12:58.503 "nvme_io": false 00:12:58.503 }, 00:12:58.503 "driver_specific": { 00:12:58.503 "lvol": { 00:12:58.503 "lvol_store_uuid": "6c55e149-f93e-4990-9de5-ebf21987c4e3", 00:12:58.503 "base_bdev": "aio_bdev", 00:12:58.503 "thin_provision": false, 00:12:58.503 "snapshot": false, 00:12:58.503 "clone": false, 00:12:58.503 "esnap_clone": false 00:12:58.503 } 00:12:58.503 } 00:12:58.503 } 00:12:58.503 ] 00:12:58.503 19:19:45 -- common/autotest_common.sh@893 -- # return 0 00:12:58.503 19:19:45 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:58.503 19:19:45 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:12:58.503 19:19:45 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:12:58.503 19:19:45 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:58.503 19:19:45 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:12:58.761 19:19:45 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:12:58.761 19:19:45 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 563e4892-5383-48a6-8674-b7846343c2e7 00:12:59.020 19:19:45 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 6c55e149-f93e-4990-9de5-ebf21987c4e3 00:12:59.020 19:19:46 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:59.278 19:19:46 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:59.278 00:12:59.278 real 0m17.482s 00:12:59.278 user 0m45.556s 00:12:59.278 sys 0m3.439s 00:12:59.278 19:19:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:59.278 19:19:46 -- common/autotest_common.sh@10 -- # set +x 00:12:59.278 ************************************ 00:12:59.278 END TEST lvs_grow_dirty 00:12:59.278 ************************************ 00:12:59.278 19:19:46 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:12:59.278 19:19:46 -- common/autotest_common.sh@794 -- # type=--id 00:12:59.278 19:19:46 -- common/autotest_common.sh@795 -- # id=0 00:12:59.278 19:19:46 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:12:59.278 19:19:46 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:12:59.278 19:19:46 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:12:59.278 19:19:46 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:12:59.278 19:19:46 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:12:59.278 19:19:46 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:12:59.278 nvmf_trace.0 00:12:59.536 19:19:46 -- common/autotest_common.sh@809 -- # return 0 00:12:59.536 19:19:46 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:12:59.536 19:19:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:59.536 19:19:46 -- nvmf/common.sh@117 -- # sync 00:12:59.536 19:19:46 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:59.536 19:19:46 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:59.536 19:19:46 -- nvmf/common.sh@120 -- # set +e 00:12:59.536 19:19:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:59.536 19:19:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:59.536 rmmod nvme_rdma 00:12:59.536 rmmod nvme_fabrics 00:12:59.536 19:19:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:59.536 19:19:46 -- nvmf/common.sh@124 -- # set -e 00:12:59.536 19:19:46 -- nvmf/common.sh@125 -- # return 0 00:12:59.536 19:19:46 -- nvmf/common.sh@478 -- # '[' -n 2988263 ']' 00:12:59.536 19:19:46 -- nvmf/common.sh@479 -- # killprocess 2988263 00:12:59.536 19:19:46 -- common/autotest_common.sh@936 -- # '[' -z 2988263 ']' 00:12:59.536 19:19:46 -- common/autotest_common.sh@940 -- # kill -0 2988263 00:12:59.536 19:19:46 -- common/autotest_common.sh@941 -- # uname 00:12:59.536 19:19:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:59.536 19:19:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2988263 00:12:59.536 19:19:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:59.536 19:19:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:59.536 19:19:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2988263' 00:12:59.536 killing process with pid 2988263 00:12:59.536 19:19:46 -- common/autotest_common.sh@955 -- # kill 2988263 00:12:59.536 19:19:46 -- common/autotest_common.sh@960 -- # wait 2988263 00:12:59.795 19:19:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:59.795 19:19:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:59.795 00:12:59.795 real 0m41.506s 00:12:59.795 user 1m7.355s 00:12:59.795 sys 0m10.099s 00:12:59.795 19:19:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:59.795 19:19:46 -- common/autotest_common.sh@10 -- # set +x 00:12:59.795 ************************************ 00:12:59.795 END TEST nvmf_lvs_grow 00:12:59.795 ************************************ 00:12:59.795 19:19:46 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:12:59.795 19:19:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:59.795 19:19:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:59.795 19:19:46 -- common/autotest_common.sh@10 -- # set +x 00:13:00.054 ************************************ 00:13:00.054 START TEST nvmf_bdev_io_wait 00:13:00.054 ************************************ 00:13:00.054 19:19:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:13:00.054 * Looking for test storage... 00:13:00.054 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:00.054 19:19:46 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:00.054 19:19:46 -- nvmf/common.sh@7 -- # uname -s 00:13:00.054 19:19:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:00.054 19:19:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:00.054 19:19:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:00.054 19:19:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:00.054 19:19:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:00.054 19:19:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:00.054 19:19:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:00.055 19:19:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:00.055 19:19:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:00.055 19:19:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:00.055 19:19:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:00.055 19:19:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:00.055 19:19:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:00.055 19:19:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:00.055 19:19:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:00.055 19:19:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:00.055 19:19:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:00.055 19:19:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:00.055 19:19:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:00.055 19:19:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:00.055 19:19:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.055 19:19:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.055 19:19:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.055 19:19:46 -- paths/export.sh@5 -- # export PATH 00:13:00.055 19:19:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.055 19:19:46 -- nvmf/common.sh@47 -- # : 0 00:13:00.055 19:19:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:00.055 19:19:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:00.055 19:19:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:00.055 19:19:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:00.055 19:19:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:00.055 19:19:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:00.055 19:19:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:00.055 19:19:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:00.055 19:19:46 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:00.055 19:19:46 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:00.055 19:19:46 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:13:00.055 19:19:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:00.055 19:19:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:00.055 19:19:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:00.055 19:19:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:00.055 19:19:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:00.055 19:19:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:00.055 19:19:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:00.055 19:19:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:00.055 19:19:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:00.055 19:19:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:00.055 19:19:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:00.055 19:19:47 -- common/autotest_common.sh@10 -- # set +x 00:13:06.625 19:19:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:06.625 19:19:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:06.625 19:19:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:06.625 19:19:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:06.625 19:19:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:06.625 19:19:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:06.625 19:19:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:06.625 19:19:52 -- nvmf/common.sh@295 -- # net_devs=() 00:13:06.625 19:19:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:06.625 19:19:52 -- nvmf/common.sh@296 -- # e810=() 00:13:06.625 19:19:52 -- nvmf/common.sh@296 -- # local -ga e810 00:13:06.625 19:19:52 -- nvmf/common.sh@297 -- # x722=() 00:13:06.625 19:19:52 -- nvmf/common.sh@297 -- # local -ga x722 00:13:06.625 19:19:52 -- nvmf/common.sh@298 -- # mlx=() 00:13:06.625 19:19:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:06.625 19:19:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:06.625 19:19:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:06.625 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:06.625 19:19:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:06.625 19:19:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:06.625 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:06.625 19:19:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:06.625 19:19:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:06.625 19:19:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:06.625 19:19:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:06.625 Found net devices under 0000:18:00.0: mlx_0_0 00:13:06.625 19:19:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:06.625 19:19:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:06.625 19:19:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:06.625 Found net devices under 0000:18:00.1: mlx_0_1 00:13:06.625 19:19:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:06.625 19:19:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:06.625 19:19:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:06.625 19:19:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:06.625 19:19:52 -- nvmf/common.sh@58 -- # uname 00:13:06.625 19:19:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:06.625 19:19:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:06.625 19:19:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:06.625 19:19:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:06.625 19:19:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:06.625 19:19:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:06.625 19:19:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:06.625 19:19:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:06.625 19:19:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:06.625 19:19:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:06.625 19:19:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:06.625 19:19:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:06.625 19:19:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:06.625 19:19:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:06.625 19:19:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:06.625 19:19:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:06.625 19:19:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:06.625 19:19:52 -- nvmf/common.sh@105 -- # continue 2 00:13:06.625 19:19:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.625 19:19:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:06.625 19:19:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:06.625 19:19:52 -- nvmf/common.sh@105 -- # continue 2 00:13:06.625 19:19:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:06.625 19:19:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:06.625 19:19:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:06.625 19:19:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:06.625 19:19:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:06.626 19:19:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:06.626 19:19:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:06.626 19:19:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:06.626 19:19:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:06.626 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:06.626 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:13:06.626 altname enp24s0f0np0 00:13:06.626 altname ens785f0np0 00:13:06.626 inet 192.168.100.8/24 scope global mlx_0_0 00:13:06.626 valid_lft forever preferred_lft forever 00:13:06.626 19:19:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:06.626 19:19:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:06.626 19:19:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:06.626 19:19:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:06.626 19:19:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:06.626 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:06.626 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:13:06.626 altname enp24s0f1np1 00:13:06.626 altname ens785f1np1 00:13:06.626 inet 192.168.100.9/24 scope global mlx_0_1 00:13:06.626 valid_lft forever preferred_lft forever 00:13:06.626 19:19:53 -- nvmf/common.sh@411 -- # return 0 00:13:06.626 19:19:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:06.626 19:19:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:06.626 19:19:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:06.626 19:19:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:06.626 19:19:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:06.626 19:19:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:06.626 19:19:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:06.626 19:19:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:06.626 19:19:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:06.626 19:19:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:06.626 19:19:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:06.626 19:19:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.626 19:19:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:06.626 19:19:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:06.626 19:19:53 -- nvmf/common.sh@105 -- # continue 2 00:13:06.626 19:19:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:06.626 19:19:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.626 19:19:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:06.626 19:19:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:06.626 19:19:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:06.626 19:19:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@105 -- # continue 2 00:13:06.626 19:19:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:06.626 19:19:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:06.626 19:19:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:06.626 19:19:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:06.626 19:19:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:06.626 19:19:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:06.626 19:19:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:06.626 192.168.100.9' 00:13:06.626 19:19:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:06.626 192.168.100.9' 00:13:06.626 19:19:53 -- nvmf/common.sh@446 -- # head -n 1 00:13:06.626 19:19:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:06.626 19:19:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:06.626 192.168.100.9' 00:13:06.626 19:19:53 -- nvmf/common.sh@447 -- # tail -n +2 00:13:06.626 19:19:53 -- nvmf/common.sh@447 -- # head -n 1 00:13:06.626 19:19:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:06.626 19:19:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:06.626 19:19:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:06.626 19:19:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:06.626 19:19:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:06.626 19:19:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:06.626 19:19:53 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:13:06.626 19:19:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:06.626 19:19:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:06.626 19:19:53 -- common/autotest_common.sh@10 -- # set +x 00:13:06.626 19:19:53 -- nvmf/common.sh@470 -- # nvmfpid=2991773 00:13:06.626 19:19:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:13:06.626 19:19:53 -- nvmf/common.sh@471 -- # waitforlisten 2991773 00:13:06.626 19:19:53 -- common/autotest_common.sh@817 -- # '[' -z 2991773 ']' 00:13:06.626 19:19:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:06.626 19:19:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:06.626 19:19:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:06.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:06.626 19:19:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:06.626 19:19:53 -- common/autotest_common.sh@10 -- # set +x 00:13:06.626 [2024-04-24 19:19:53.190669] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:06.626 [2024-04-24 19:19:53.190731] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:06.626 EAL: No free 2048 kB hugepages reported on node 1 00:13:06.626 [2024-04-24 19:19:53.264389] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:06.626 [2024-04-24 19:19:53.355007] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:06.626 [2024-04-24 19:19:53.355048] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:06.626 [2024-04-24 19:19:53.355057] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:06.626 [2024-04-24 19:19:53.355082] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:06.626 [2024-04-24 19:19:53.355090] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:06.626 [2024-04-24 19:19:53.355150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:06.626 [2024-04-24 19:19:53.355251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:06.626 [2024-04-24 19:19:53.355316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:06.626 [2024-04-24 19:19:53.355317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:07.196 19:19:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:07.196 19:19:54 -- common/autotest_common.sh@850 -- # return 0 00:13:07.196 19:19:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:07.196 19:19:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:07.196 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.196 19:19:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:07.196 19:19:54 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:13:07.196 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.196 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.196 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.196 19:19:54 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:13:07.196 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.196 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.196 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.196 19:19:54 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:07.196 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.196 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.196 [2024-04-24 19:19:54.157352] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x193d2a0/0x1941790) succeed. 00:13:07.196 [2024-04-24 19:19:54.167534] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x193e8e0/0x1982e20) succeed. 00:13:07.455 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.455 19:19:54 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:07.455 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.455 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.455 Malloc0 00:13:07.455 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.455 19:19:54 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:07.455 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.455 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.455 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.455 19:19:54 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:07.455 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.455 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.455 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.455 19:19:54 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:07.455 19:19:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:07.455 19:19:54 -- common/autotest_common.sh@10 -- # set +x 00:13:07.456 [2024-04-24 19:19:54.352282] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:07.456 19:19:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2991976 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@30 -- # READ_PID=2991978 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # config=() 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # local subsystem config 00:13:07.456 19:19:54 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:07.456 { 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme$subsystem", 00:13:07.456 "trtype": "$TEST_TRANSPORT", 00:13:07.456 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "$NVMF_PORT", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:07.456 "hdgst": ${hdgst:-false}, 00:13:07.456 "ddgst": ${ddgst:-false} 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 } 00:13:07.456 EOF 00:13:07.456 )") 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2991980 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # config=() 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # local subsystem config 00:13:07.456 19:19:54 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:07.456 { 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme$subsystem", 00:13:07.456 "trtype": "$TEST_TRANSPORT", 00:13:07.456 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "$NVMF_PORT", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:07.456 "hdgst": ${hdgst:-false}, 00:13:07.456 "ddgst": ${ddgst:-false} 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 } 00:13:07.456 EOF 00:13:07.456 )") 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2991983 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@35 -- # sync 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # cat 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # config=() 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # local subsystem config 00:13:07.456 19:19:54 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:07.456 { 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme$subsystem", 00:13:07.456 "trtype": "$TEST_TRANSPORT", 00:13:07.456 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "$NVMF_PORT", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:07.456 "hdgst": ${hdgst:-false}, 00:13:07.456 "ddgst": ${ddgst:-false} 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 } 00:13:07.456 EOF 00:13:07.456 )") 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # config=() 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # cat 00:13:07.456 19:19:54 -- nvmf/common.sh@521 -- # local subsystem config 00:13:07.456 19:19:54 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:07.456 { 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme$subsystem", 00:13:07.456 "trtype": "$TEST_TRANSPORT", 00:13:07.456 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "$NVMF_PORT", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:07.456 "hdgst": ${hdgst:-false}, 00:13:07.456 "ddgst": ${ddgst:-false} 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 } 00:13:07.456 EOF 00:13:07.456 )") 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # cat 00:13:07.456 19:19:54 -- target/bdev_io_wait.sh@37 -- # wait 2991976 00:13:07.456 19:19:54 -- nvmf/common.sh@543 -- # cat 00:13:07.456 19:19:54 -- nvmf/common.sh@545 -- # jq . 00:13:07.456 19:19:54 -- nvmf/common.sh@545 -- # jq . 00:13:07.456 19:19:54 -- nvmf/common.sh@545 -- # jq . 00:13:07.456 19:19:54 -- nvmf/common.sh@546 -- # IFS=, 00:13:07.456 19:19:54 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme1", 00:13:07.456 "trtype": "rdma", 00:13:07.456 "traddr": "192.168.100.8", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "4420", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:07.456 "hdgst": false, 00:13:07.456 "ddgst": false 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 }' 00:13:07.456 19:19:54 -- nvmf/common.sh@545 -- # jq . 00:13:07.456 19:19:54 -- nvmf/common.sh@546 -- # IFS=, 00:13:07.456 19:19:54 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme1", 00:13:07.456 "trtype": "rdma", 00:13:07.456 "traddr": "192.168.100.8", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "4420", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:07.456 "hdgst": false, 00:13:07.456 "ddgst": false 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 }' 00:13:07.456 19:19:54 -- nvmf/common.sh@546 -- # IFS=, 00:13:07.456 19:19:54 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme1", 00:13:07.456 "trtype": "rdma", 00:13:07.456 "traddr": "192.168.100.8", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "4420", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:07.456 "hdgst": false, 00:13:07.456 "ddgst": false 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 }' 00:13:07.456 19:19:54 -- nvmf/common.sh@546 -- # IFS=, 00:13:07.456 19:19:54 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:07.456 "params": { 00:13:07.456 "name": "Nvme1", 00:13:07.456 "trtype": "rdma", 00:13:07.456 "traddr": "192.168.100.8", 00:13:07.456 "adrfam": "ipv4", 00:13:07.456 "trsvcid": "4420", 00:13:07.456 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:07.456 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:07.456 "hdgst": false, 00:13:07.456 "ddgst": false 00:13:07.456 }, 00:13:07.456 "method": "bdev_nvme_attach_controller" 00:13:07.456 }' 00:13:07.456 [2024-04-24 19:19:54.403210] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:07.456 [2024-04-24 19:19:54.403220] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:07.456 [2024-04-24 19:19:54.403279] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:13:07.456 [2024-04-24 19:19:54.403282] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:13:07.456 [2024-04-24 19:19:54.404384] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:07.456 [2024-04-24 19:19:54.404433] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:13:07.456 [2024-04-24 19:19:54.406001] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:07.456 [2024-04-24 19:19:54.406052] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:13:07.456 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.715 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.715 [2024-04-24 19:19:54.599404] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:07.715 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.715 [2024-04-24 19:19:54.682660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:13:07.715 [2024-04-24 19:19:54.700331] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:07.976 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.976 [2024-04-24 19:19:54.783894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:07.976 [2024-04-24 19:19:54.807956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:07.976 [2024-04-24 19:19:54.891331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:13:07.976 [2024-04-24 19:19:54.914373] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:08.235 [2024-04-24 19:19:55.000364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:13:08.235 Running I/O for 1 seconds... 00:13:08.235 Running I/O for 1 seconds... 00:13:08.235 Running I/O for 1 seconds... 00:13:08.235 Running I/O for 1 seconds... 00:13:09.209 00:13:09.209 Latency(us) 00:13:09.209 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:09.209 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:13:09.209 Nvme1n1 : 1.01 16663.35 65.09 0.00 0.00 7657.33 5385.35 19261.89 00:13:09.209 =================================================================================================================== 00:13:09.209 Total : 16663.35 65.09 0.00 0.00 7657.33 5385.35 19261.89 00:13:09.209 00:13:09.209 Latency(us) 00:13:09.209 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:09.209 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:13:09.209 Nvme1n1 : 1.01 15691.24 61.29 0.00 0.00 8130.32 5784.26 17438.27 00:13:09.209 =================================================================================================================== 00:13:09.209 Total : 15691.24 61.29 0.00 0.00 8130.32 5784.26 17438.27 00:13:09.209 00:13:09.209 Latency(us) 00:13:09.209 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:09.209 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:13:09.209 Nvme1n1 : 1.00 17620.78 68.83 0.00 0.00 7249.32 3305.29 16640.45 00:13:09.209 =================================================================================================================== 00:13:09.209 Total : 17620.78 68.83 0.00 0.00 7249.32 3305.29 16640.45 00:13:09.209 00:13:09.209 Latency(us) 00:13:09.209 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:09.209 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:13:09.209 Nvme1n1 : 1.00 261175.49 1020.22 0.00 0.00 487.69 193.22 1837.86 00:13:09.209 =================================================================================================================== 00:13:09.209 Total : 261175.49 1020.22 0.00 0.00 487.69 193.22 1837.86 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@38 -- # wait 2991978 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@39 -- # wait 2991980 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@40 -- # wait 2991983 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:09.491 19:19:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:09.491 19:19:56 -- common/autotest_common.sh@10 -- # set +x 00:13:09.491 19:19:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:13:09.491 19:19:56 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:13:09.491 19:19:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:09.491 19:19:56 -- nvmf/common.sh@117 -- # sync 00:13:09.491 19:19:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:09.491 19:19:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:09.491 19:19:56 -- nvmf/common.sh@120 -- # set +e 00:13:09.491 19:19:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:09.491 19:19:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:09.491 rmmod nvme_rdma 00:13:09.491 rmmod nvme_fabrics 00:13:09.491 19:19:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:09.491 19:19:56 -- nvmf/common.sh@124 -- # set -e 00:13:09.491 19:19:56 -- nvmf/common.sh@125 -- # return 0 00:13:09.491 19:19:56 -- nvmf/common.sh@478 -- # '[' -n 2991773 ']' 00:13:09.491 19:19:56 -- nvmf/common.sh@479 -- # killprocess 2991773 00:13:09.491 19:19:56 -- common/autotest_common.sh@936 -- # '[' -z 2991773 ']' 00:13:09.491 19:19:56 -- common/autotest_common.sh@940 -- # kill -0 2991773 00:13:09.491 19:19:56 -- common/autotest_common.sh@941 -- # uname 00:13:09.491 19:19:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:09.491 19:19:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2991773 00:13:09.491 19:19:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:09.491 19:19:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:09.491 19:19:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2991773' 00:13:09.491 killing process with pid 2991773 00:13:09.491 19:19:56 -- common/autotest_common.sh@955 -- # kill 2991773 00:13:09.491 19:19:56 -- common/autotest_common.sh@960 -- # wait 2991773 00:13:09.750 [2024-04-24 19:19:56.567039] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:09.750 19:19:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:09.750 19:19:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:09.750 00:13:09.750 real 0m9.901s 00:13:09.750 user 0m20.927s 00:13:09.750 sys 0m6.117s 00:13:09.750 19:19:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:09.750 19:19:56 -- common/autotest_common.sh@10 -- # set +x 00:13:09.750 ************************************ 00:13:09.750 END TEST nvmf_bdev_io_wait 00:13:09.750 ************************************ 00:13:10.010 19:19:56 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:13:10.010 19:19:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:10.010 19:19:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:10.010 19:19:56 -- common/autotest_common.sh@10 -- # set +x 00:13:10.010 ************************************ 00:13:10.010 START TEST nvmf_queue_depth 00:13:10.010 ************************************ 00:13:10.010 19:19:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:13:10.269 * Looking for test storage... 00:13:10.269 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:10.269 19:19:57 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:10.269 19:19:57 -- nvmf/common.sh@7 -- # uname -s 00:13:10.269 19:19:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:10.269 19:19:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:10.269 19:19:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:10.269 19:19:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:10.269 19:19:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:10.269 19:19:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:10.269 19:19:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:10.269 19:19:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:10.269 19:19:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:10.269 19:19:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:10.269 19:19:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:10.269 19:19:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:10.269 19:19:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:10.269 19:19:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:10.269 19:19:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:10.269 19:19:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:10.269 19:19:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:10.269 19:19:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:10.269 19:19:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:10.269 19:19:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:10.269 19:19:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.269 19:19:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.269 19:19:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.269 19:19:57 -- paths/export.sh@5 -- # export PATH 00:13:10.269 19:19:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.269 19:19:57 -- nvmf/common.sh@47 -- # : 0 00:13:10.269 19:19:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:10.269 19:19:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:10.269 19:19:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:10.269 19:19:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:10.269 19:19:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:10.269 19:19:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:10.269 19:19:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:10.269 19:19:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:10.269 19:19:57 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:13:10.269 19:19:57 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:13:10.269 19:19:57 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:10.269 19:19:57 -- target/queue_depth.sh@19 -- # nvmftestinit 00:13:10.269 19:19:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:10.269 19:19:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:10.269 19:19:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:10.269 19:19:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:10.269 19:19:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:10.269 19:19:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:10.269 19:19:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:10.269 19:19:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:10.269 19:19:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:10.269 19:19:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:10.269 19:19:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:10.269 19:19:57 -- common/autotest_common.sh@10 -- # set +x 00:13:16.837 19:20:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:16.837 19:20:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:16.837 19:20:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:16.837 19:20:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:16.837 19:20:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:16.837 19:20:02 -- nvmf/common.sh@295 -- # net_devs=() 00:13:16.837 19:20:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@296 -- # e810=() 00:13:16.837 19:20:02 -- nvmf/common.sh@296 -- # local -ga e810 00:13:16.837 19:20:02 -- nvmf/common.sh@297 -- # x722=() 00:13:16.837 19:20:02 -- nvmf/common.sh@297 -- # local -ga x722 00:13:16.837 19:20:02 -- nvmf/common.sh@298 -- # mlx=() 00:13:16.837 19:20:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:16.837 19:20:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:16.837 19:20:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:16.837 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:16.837 19:20:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:16.837 19:20:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:16.837 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:16.837 19:20:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:16.837 19:20:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.837 19:20:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.837 19:20:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:16.837 Found net devices under 0000:18:00.0: mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.837 19:20:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.837 19:20:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:16.837 Found net devices under 0000:18:00.1: mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.837 19:20:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:16.837 19:20:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:16.837 19:20:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:16.837 19:20:02 -- nvmf/common.sh@58 -- # uname 00:13:16.837 19:20:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:16.837 19:20:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:16.837 19:20:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:16.837 19:20:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:16.837 19:20:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:16.837 19:20:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:16.837 19:20:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:16.837 19:20:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:16.837 19:20:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:16.837 19:20:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:16.837 19:20:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:16.837 19:20:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:16.837 19:20:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:16.837 19:20:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@105 -- # continue 2 00:13:16.837 19:20:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@105 -- # continue 2 00:13:16.837 19:20:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:16.837 19:20:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:16.837 19:20:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:16.837 19:20:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:16.837 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:16.837 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:13:16.837 altname enp24s0f0np0 00:13:16.837 altname ens785f0np0 00:13:16.837 inet 192.168.100.8/24 scope global mlx_0_0 00:13:16.837 valid_lft forever preferred_lft forever 00:13:16.837 19:20:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:16.837 19:20:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:16.837 19:20:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:16.837 19:20:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:16.837 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:16.837 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:13:16.837 altname enp24s0f1np1 00:13:16.837 altname ens785f1np1 00:13:16.837 inet 192.168.100.9/24 scope global mlx_0_1 00:13:16.837 valid_lft forever preferred_lft forever 00:13:16.837 19:20:02 -- nvmf/common.sh@411 -- # return 0 00:13:16.837 19:20:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:16.837 19:20:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:16.837 19:20:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:16.837 19:20:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:16.837 19:20:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:16.837 19:20:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:16.837 19:20:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:16.837 19:20:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:16.837 19:20:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@105 -- # continue 2 00:13:16.837 19:20:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:16.837 19:20:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:16.837 19:20:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@105 -- # continue 2 00:13:16.837 19:20:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:16.837 19:20:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:16.837 19:20:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:16.837 19:20:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:16.837 19:20:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:16.837 19:20:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:16.837 192.168.100.9' 00:13:16.837 19:20:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:16.837 192.168.100.9' 00:13:16.837 19:20:02 -- nvmf/common.sh@446 -- # head -n 1 00:13:16.837 19:20:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:16.837 19:20:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:16.837 192.168.100.9' 00:13:16.837 19:20:03 -- nvmf/common.sh@447 -- # tail -n +2 00:13:16.837 19:20:03 -- nvmf/common.sh@447 -- # head -n 1 00:13:16.837 19:20:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:16.838 19:20:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:16.838 19:20:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:16.838 19:20:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:16.838 19:20:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:16.838 19:20:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:16.838 19:20:03 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:13:16.838 19:20:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:16.838 19:20:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:16.838 19:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:16.838 19:20:03 -- nvmf/common.sh@470 -- # nvmfpid=2995097 00:13:16.838 19:20:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:16.838 19:20:03 -- nvmf/common.sh@471 -- # waitforlisten 2995097 00:13:16.838 19:20:03 -- common/autotest_common.sh@817 -- # '[' -z 2995097 ']' 00:13:16.838 19:20:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:16.838 19:20:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:16.838 19:20:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:16.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:16.838 19:20:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:16.838 19:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:16.838 [2024-04-24 19:20:03.100600] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:16.838 [2024-04-24 19:20:03.100664] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:16.838 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.838 [2024-04-24 19:20:03.177169] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.838 [2024-04-24 19:20:03.265831] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:16.838 [2024-04-24 19:20:03.265873] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:16.838 [2024-04-24 19:20:03.265883] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:16.838 [2024-04-24 19:20:03.265907] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:16.838 [2024-04-24 19:20:03.265914] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:16.838 [2024-04-24 19:20:03.265946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:17.097 19:20:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:17.097 19:20:03 -- common/autotest_common.sh@850 -- # return 0 00:13:17.097 19:20:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:17.097 19:20:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:17.097 19:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 19:20:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:17.097 19:20:03 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:17.097 19:20:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.097 19:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 [2024-04-24 19:20:03.984271] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c853e0/0x1c898d0) succeed. 00:13:17.097 [2024-04-24 19:20:03.993952] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c868e0/0x1ccaf60) succeed. 00:13:17.097 19:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:17.097 19:20:04 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:17.097 19:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.097 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 Malloc0 00:13:17.097 19:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:17.097 19:20:04 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:17.097 19:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.097 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 19:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:17.097 19:20:04 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:17.097 19:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.097 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 19:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:17.097 19:20:04 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:17.097 19:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.097 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:17.097 [2024-04-24 19:20:04.075222] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:17.097 19:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:17.097 19:20:04 -- target/queue_depth.sh@30 -- # bdevperf_pid=2995296 00:13:17.097 19:20:04 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:13:17.097 19:20:04 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:17.097 19:20:04 -- target/queue_depth.sh@33 -- # waitforlisten 2995296 /var/tmp/bdevperf.sock 00:13:17.097 19:20:04 -- common/autotest_common.sh@817 -- # '[' -z 2995296 ']' 00:13:17.097 19:20:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:17.097 19:20:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:17.097 19:20:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:17.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:17.097 19:20:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:17.097 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:17.356 [2024-04-24 19:20:04.127935] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:17.356 [2024-04-24 19:20:04.127981] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2995296 ] 00:13:17.356 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.356 [2024-04-24 19:20:04.199931] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:17.356 [2024-04-24 19:20:04.287580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:17.924 19:20:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:17.924 19:20:04 -- common/autotest_common.sh@850 -- # return 0 00:13:17.924 19:20:04 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:13:17.924 19:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:17.924 19:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:18.183 NVMe0n1 00:13:18.183 19:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.183 19:20:05 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:13:18.183 Running I/O for 10 seconds... 00:13:28.160 00:13:28.160 Latency(us) 00:13:28.160 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:28.160 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:13:28.160 Verification LBA range: start 0x0 length 0x4000 00:13:28.160 NVMe0n1 : 10.03 17872.20 69.81 0.00 0.00 57156.00 21427.42 38067.87 00:13:28.160 =================================================================================================================== 00:13:28.160 Total : 17872.20 69.81 0.00 0.00 57156.00 21427.42 38067.87 00:13:28.160 0 00:13:28.160 19:20:15 -- target/queue_depth.sh@39 -- # killprocess 2995296 00:13:28.160 19:20:15 -- common/autotest_common.sh@936 -- # '[' -z 2995296 ']' 00:13:28.160 19:20:15 -- common/autotest_common.sh@940 -- # kill -0 2995296 00:13:28.160 19:20:15 -- common/autotest_common.sh@941 -- # uname 00:13:28.420 19:20:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.420 19:20:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2995296 00:13:28.420 19:20:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:28.420 19:20:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:28.420 19:20:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2995296' 00:13:28.420 killing process with pid 2995296 00:13:28.420 19:20:15 -- common/autotest_common.sh@955 -- # kill 2995296 00:13:28.420 Received shutdown signal, test time was about 10.000000 seconds 00:13:28.420 00:13:28.420 Latency(us) 00:13:28.420 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:28.420 =================================================================================================================== 00:13:28.420 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:13:28.420 19:20:15 -- common/autotest_common.sh@960 -- # wait 2995296 00:13:28.679 19:20:15 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:28.679 19:20:15 -- target/queue_depth.sh@43 -- # nvmftestfini 00:13:28.679 19:20:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:28.679 19:20:15 -- nvmf/common.sh@117 -- # sync 00:13:28.679 19:20:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:28.679 19:20:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:28.679 19:20:15 -- nvmf/common.sh@120 -- # set +e 00:13:28.679 19:20:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:28.679 19:20:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:28.679 rmmod nvme_rdma 00:13:28.679 rmmod nvme_fabrics 00:13:28.679 19:20:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:28.679 19:20:15 -- nvmf/common.sh@124 -- # set -e 00:13:28.679 19:20:15 -- nvmf/common.sh@125 -- # return 0 00:13:28.679 19:20:15 -- nvmf/common.sh@478 -- # '[' -n 2995097 ']' 00:13:28.679 19:20:15 -- nvmf/common.sh@479 -- # killprocess 2995097 00:13:28.679 19:20:15 -- common/autotest_common.sh@936 -- # '[' -z 2995097 ']' 00:13:28.679 19:20:15 -- common/autotest_common.sh@940 -- # kill -0 2995097 00:13:28.679 19:20:15 -- common/autotest_common.sh@941 -- # uname 00:13:28.679 19:20:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.679 19:20:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2995097 00:13:28.679 19:20:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:28.679 19:20:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:28.679 19:20:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2995097' 00:13:28.679 killing process with pid 2995097 00:13:28.679 19:20:15 -- common/autotest_common.sh@955 -- # kill 2995097 00:13:28.679 19:20:15 -- common/autotest_common.sh@960 -- # wait 2995097 00:13:28.679 [2024-04-24 19:20:15.621182] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:28.938 19:20:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:28.938 19:20:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:28.938 00:13:28.938 real 0m18.893s 00:13:28.938 user 0m26.010s 00:13:28.938 sys 0m5.306s 00:13:28.938 19:20:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:28.938 19:20:15 -- common/autotest_common.sh@10 -- # set +x 00:13:28.938 ************************************ 00:13:28.938 END TEST nvmf_queue_depth 00:13:28.938 ************************************ 00:13:28.938 19:20:15 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:13:28.938 19:20:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:28.938 19:20:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:28.938 19:20:15 -- common/autotest_common.sh@10 -- # set +x 00:13:29.197 ************************************ 00:13:29.197 START TEST nvmf_multipath 00:13:29.197 ************************************ 00:13:29.197 19:20:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:13:29.197 * Looking for test storage... 00:13:29.197 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:29.197 19:20:16 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:29.197 19:20:16 -- nvmf/common.sh@7 -- # uname -s 00:13:29.197 19:20:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:29.197 19:20:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:29.197 19:20:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:29.197 19:20:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:29.197 19:20:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:29.197 19:20:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:29.197 19:20:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:29.197 19:20:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:29.197 19:20:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:29.197 19:20:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:29.197 19:20:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:29.197 19:20:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:29.197 19:20:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:29.197 19:20:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:29.197 19:20:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:29.197 19:20:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:29.197 19:20:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:29.197 19:20:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:29.197 19:20:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:29.197 19:20:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:29.197 19:20:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.197 19:20:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.197 19:20:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.197 19:20:16 -- paths/export.sh@5 -- # export PATH 00:13:29.197 19:20:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:29.197 19:20:16 -- nvmf/common.sh@47 -- # : 0 00:13:29.197 19:20:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:29.197 19:20:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:29.197 19:20:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:29.197 19:20:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:29.197 19:20:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:29.198 19:20:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:29.198 19:20:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:29.198 19:20:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:29.198 19:20:16 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:29.198 19:20:16 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:29.198 19:20:16 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:13:29.198 19:20:16 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:29.198 19:20:16 -- target/multipath.sh@43 -- # nvmftestinit 00:13:29.198 19:20:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:29.198 19:20:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:29.198 19:20:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:29.198 19:20:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:29.198 19:20:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:29.198 19:20:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.198 19:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.198 19:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:29.198 19:20:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:29.198 19:20:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:29.198 19:20:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:29.198 19:20:16 -- common/autotest_common.sh@10 -- # set +x 00:13:35.768 19:20:22 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:35.768 19:20:22 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:35.768 19:20:22 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:35.768 19:20:22 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:35.768 19:20:22 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:35.768 19:20:22 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:35.768 19:20:22 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:35.768 19:20:22 -- nvmf/common.sh@295 -- # net_devs=() 00:13:35.768 19:20:22 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:35.768 19:20:22 -- nvmf/common.sh@296 -- # e810=() 00:13:35.768 19:20:22 -- nvmf/common.sh@296 -- # local -ga e810 00:13:35.768 19:20:22 -- nvmf/common.sh@297 -- # x722=() 00:13:35.768 19:20:22 -- nvmf/common.sh@297 -- # local -ga x722 00:13:35.768 19:20:22 -- nvmf/common.sh@298 -- # mlx=() 00:13:35.768 19:20:22 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:35.768 19:20:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:35.768 19:20:22 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:35.768 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:35.768 19:20:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:35.768 19:20:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:35.768 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:35.768 19:20:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:35.768 19:20:22 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.768 19:20:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.768 19:20:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:35.768 Found net devices under 0000:18:00.0: mlx_0_0 00:13:35.768 19:20:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.768 19:20:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.768 19:20:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:35.768 Found net devices under 0000:18:00.1: mlx_0_1 00:13:35.768 19:20:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.768 19:20:22 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:35.768 19:20:22 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:35.768 19:20:22 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:35.768 19:20:22 -- nvmf/common.sh@58 -- # uname 00:13:35.768 19:20:22 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:35.768 19:20:22 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:35.768 19:20:22 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:35.768 19:20:22 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:35.768 19:20:22 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:35.768 19:20:22 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:35.768 19:20:22 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:35.768 19:20:22 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:35.768 19:20:22 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:35.768 19:20:22 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:35.768 19:20:22 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:35.768 19:20:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:35.768 19:20:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:35.768 19:20:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:35.768 19:20:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:35.768 19:20:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:35.768 19:20:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:35.768 19:20:22 -- nvmf/common.sh@105 -- # continue 2 00:13:35.768 19:20:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.768 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:35.768 19:20:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:35.768 19:20:22 -- nvmf/common.sh@105 -- # continue 2 00:13:35.768 19:20:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:35.768 19:20:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:35.768 19:20:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:35.768 19:20:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:35.769 19:20:22 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:35.769 19:20:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:35.769 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:35.769 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:13:35.769 altname enp24s0f0np0 00:13:35.769 altname ens785f0np0 00:13:35.769 inet 192.168.100.8/24 scope global mlx_0_0 00:13:35.769 valid_lft forever preferred_lft forever 00:13:35.769 19:20:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:35.769 19:20:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:35.769 19:20:22 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:35.769 19:20:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:35.769 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:35.769 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:13:35.769 altname enp24s0f1np1 00:13:35.769 altname ens785f1np1 00:13:35.769 inet 192.168.100.9/24 scope global mlx_0_1 00:13:35.769 valid_lft forever preferred_lft forever 00:13:35.769 19:20:22 -- nvmf/common.sh@411 -- # return 0 00:13:35.769 19:20:22 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:35.769 19:20:22 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:35.769 19:20:22 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:35.769 19:20:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:35.769 19:20:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:35.769 19:20:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:35.769 19:20:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:35.769 19:20:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:35.769 19:20:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:35.769 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.769 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:35.769 19:20:22 -- nvmf/common.sh@105 -- # continue 2 00:13:35.769 19:20:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:35.769 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.769 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:35.769 19:20:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:35.769 19:20:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@105 -- # continue 2 00:13:35.769 19:20:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:35.769 19:20:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:35.769 19:20:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:35.769 19:20:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:35.769 19:20:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:35.769 19:20:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:35.769 19:20:22 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:35.769 192.168.100.9' 00:13:35.769 19:20:22 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:35.769 192.168.100.9' 00:13:35.769 19:20:22 -- nvmf/common.sh@446 -- # head -n 1 00:13:35.769 19:20:22 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:35.769 19:20:22 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:35.769 192.168.100.9' 00:13:35.769 19:20:22 -- nvmf/common.sh@447 -- # head -n 1 00:13:35.769 19:20:22 -- nvmf/common.sh@447 -- # tail -n +2 00:13:35.769 19:20:22 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:35.769 19:20:22 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:35.769 19:20:22 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:35.769 19:20:22 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:13:35.769 19:20:22 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:13:35.769 19:20:22 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:13:35.769 run this test only with TCP transport for now 00:13:35.769 19:20:22 -- target/multipath.sh@53 -- # nvmftestfini 00:13:35.769 19:20:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:35.769 19:20:22 -- nvmf/common.sh@117 -- # sync 00:13:35.769 19:20:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@120 -- # set +e 00:13:35.769 19:20:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:35.769 19:20:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:35.769 rmmod nvme_rdma 00:13:35.769 rmmod nvme_fabrics 00:13:35.769 19:20:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:35.769 19:20:22 -- nvmf/common.sh@124 -- # set -e 00:13:35.769 19:20:22 -- nvmf/common.sh@125 -- # return 0 00:13:35.769 19:20:22 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:35.769 19:20:22 -- target/multipath.sh@54 -- # exit 0 00:13:35.769 19:20:22 -- target/multipath.sh@1 -- # nvmftestfini 00:13:35.769 19:20:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:35.769 19:20:22 -- nvmf/common.sh@117 -- # sync 00:13:35.769 19:20:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@120 -- # set +e 00:13:35.769 19:20:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:35.769 19:20:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:35.769 19:20:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:35.769 19:20:22 -- nvmf/common.sh@124 -- # set -e 00:13:35.769 19:20:22 -- nvmf/common.sh@125 -- # return 0 00:13:35.769 19:20:22 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:35.769 19:20:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:35.769 00:13:35.769 real 0m6.441s 00:13:35.769 user 0m1.749s 00:13:35.769 sys 0m4.865s 00:13:35.769 19:20:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:35.769 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:13:35.769 ************************************ 00:13:35.769 END TEST nvmf_multipath 00:13:35.769 ************************************ 00:13:35.769 19:20:22 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:13:35.769 19:20:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:35.769 19:20:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:35.769 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:13:35.769 ************************************ 00:13:35.769 START TEST nvmf_zcopy 00:13:35.769 ************************************ 00:13:35.769 19:20:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:13:36.029 * Looking for test storage... 00:13:36.029 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:36.029 19:20:22 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:36.029 19:20:22 -- nvmf/common.sh@7 -- # uname -s 00:13:36.029 19:20:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:36.029 19:20:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:36.029 19:20:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:36.029 19:20:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:36.029 19:20:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:36.029 19:20:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:36.029 19:20:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:36.029 19:20:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:36.029 19:20:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:36.029 19:20:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:36.029 19:20:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:36.029 19:20:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:36.029 19:20:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:36.029 19:20:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:36.029 19:20:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:36.029 19:20:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:36.030 19:20:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:36.030 19:20:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:36.030 19:20:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:36.030 19:20:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:36.030 19:20:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.030 19:20:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.030 19:20:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.030 19:20:22 -- paths/export.sh@5 -- # export PATH 00:13:36.030 19:20:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.030 19:20:22 -- nvmf/common.sh@47 -- # : 0 00:13:36.030 19:20:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:36.030 19:20:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:36.030 19:20:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:36.030 19:20:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:36.030 19:20:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:36.030 19:20:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:36.030 19:20:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:36.030 19:20:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:36.030 19:20:22 -- target/zcopy.sh@12 -- # nvmftestinit 00:13:36.030 19:20:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:36.030 19:20:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:36.030 19:20:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:36.030 19:20:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:36.030 19:20:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:36.030 19:20:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:36.030 19:20:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:36.030 19:20:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.030 19:20:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:36.030 19:20:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:36.030 19:20:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:36.030 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:13:42.608 19:20:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.608 19:20:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:42.608 19:20:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:42.608 19:20:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:42.608 19:20:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:42.608 19:20:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:42.608 19:20:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:42.608 19:20:28 -- nvmf/common.sh@295 -- # net_devs=() 00:13:42.608 19:20:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:42.608 19:20:28 -- nvmf/common.sh@296 -- # e810=() 00:13:42.608 19:20:28 -- nvmf/common.sh@296 -- # local -ga e810 00:13:42.608 19:20:28 -- nvmf/common.sh@297 -- # x722=() 00:13:42.608 19:20:28 -- nvmf/common.sh@297 -- # local -ga x722 00:13:42.608 19:20:28 -- nvmf/common.sh@298 -- # mlx=() 00:13:42.608 19:20:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:42.608 19:20:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.608 19:20:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:42.608 19:20:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:42.608 19:20:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:42.608 19:20:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:42.608 19:20:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:42.608 19:20:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.608 19:20:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:42.608 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:42.608 19:20:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.608 19:20:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.608 19:20:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:42.608 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:42.608 19:20:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.608 19:20:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:42.608 19:20:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:42.608 19:20:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.608 19:20:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.608 19:20:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.608 19:20:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.608 19:20:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:42.608 Found net devices under 0000:18:00.0: mlx_0_0 00:13:42.608 19:20:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.609 19:20:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.609 19:20:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.609 19:20:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.609 19:20:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:42.609 Found net devices under 0000:18:00.1: mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.609 19:20:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:42.609 19:20:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:42.609 19:20:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:42.609 19:20:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:42.609 19:20:28 -- nvmf/common.sh@58 -- # uname 00:13:42.609 19:20:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:42.609 19:20:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:42.609 19:20:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:42.609 19:20:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:42.609 19:20:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:42.609 19:20:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:42.609 19:20:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:42.609 19:20:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:42.609 19:20:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:42.609 19:20:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:42.609 19:20:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:42.609 19:20:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:42.609 19:20:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:42.609 19:20:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:42.609 19:20:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:42.609 19:20:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:42.609 19:20:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@105 -- # continue 2 00:13:42.609 19:20:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@105 -- # continue 2 00:13:42.609 19:20:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:42.609 19:20:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.609 19:20:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:42.609 19:20:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:42.609 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:42.609 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:13:42.609 altname enp24s0f0np0 00:13:42.609 altname ens785f0np0 00:13:42.609 inet 192.168.100.8/24 scope global mlx_0_0 00:13:42.609 valid_lft forever preferred_lft forever 00:13:42.609 19:20:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:42.609 19:20:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.609 19:20:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:42.609 19:20:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:42.609 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:42.609 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:13:42.609 altname enp24s0f1np1 00:13:42.609 altname ens785f1np1 00:13:42.609 inet 192.168.100.9/24 scope global mlx_0_1 00:13:42.609 valid_lft forever preferred_lft forever 00:13:42.609 19:20:28 -- nvmf/common.sh@411 -- # return 0 00:13:42.609 19:20:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:42.609 19:20:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:42.609 19:20:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:42.609 19:20:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:42.609 19:20:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:42.609 19:20:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:42.609 19:20:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:42.609 19:20:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:42.609 19:20:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:42.609 19:20:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@105 -- # continue 2 00:13:42.609 19:20:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.609 19:20:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:42.609 19:20:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@105 -- # continue 2 00:13:42.609 19:20:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:42.609 19:20:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.609 19:20:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:42.609 19:20:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.609 19:20:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.609 19:20:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:42.609 192.168.100.9' 00:13:42.609 19:20:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:42.609 192.168.100.9' 00:13:42.609 19:20:28 -- nvmf/common.sh@446 -- # head -n 1 00:13:42.609 19:20:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:42.609 19:20:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:42.609 192.168.100.9' 00:13:42.609 19:20:28 -- nvmf/common.sh@447 -- # tail -n +2 00:13:42.609 19:20:28 -- nvmf/common.sh@447 -- # head -n 1 00:13:42.609 19:20:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:42.609 19:20:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:42.609 19:20:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:42.609 19:20:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:42.609 19:20:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:42.609 19:20:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:42.609 19:20:28 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:13:42.609 19:20:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:42.609 19:20:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:42.609 19:20:28 -- common/autotest_common.sh@10 -- # set +x 00:13:42.609 19:20:28 -- nvmf/common.sh@470 -- # nvmfpid=3002549 00:13:42.609 19:20:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:42.609 19:20:28 -- nvmf/common.sh@471 -- # waitforlisten 3002549 00:13:42.609 19:20:28 -- common/autotest_common.sh@817 -- # '[' -z 3002549 ']' 00:13:42.609 19:20:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.609 19:20:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:42.609 19:20:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.609 19:20:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:42.609 19:20:28 -- common/autotest_common.sh@10 -- # set +x 00:13:42.609 [2024-04-24 19:20:28.864131] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:42.609 [2024-04-24 19:20:28.864193] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.609 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.609 [2024-04-24 19:20:28.938626] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:42.609 [2024-04-24 19:20:29.026651] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.609 [2024-04-24 19:20:29.026695] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.609 [2024-04-24 19:20:29.026704] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:42.609 [2024-04-24 19:20:29.026728] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:42.609 [2024-04-24 19:20:29.026735] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.609 [2024-04-24 19:20:29.026762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.869 19:20:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:42.869 19:20:29 -- common/autotest_common.sh@850 -- # return 0 00:13:42.869 19:20:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:42.869 19:20:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:42.869 19:20:29 -- common/autotest_common.sh@10 -- # set +x 00:13:42.869 19:20:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:42.869 19:20:29 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:13:42.869 19:20:29 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:13:42.869 Unsupported transport: rdma 00:13:42.869 19:20:29 -- target/zcopy.sh@17 -- # exit 0 00:13:42.869 19:20:29 -- target/zcopy.sh@1 -- # process_shm --id 0 00:13:42.869 19:20:29 -- common/autotest_common.sh@794 -- # type=--id 00:13:42.869 19:20:29 -- common/autotest_common.sh@795 -- # id=0 00:13:42.869 19:20:29 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:13:42.869 19:20:29 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:13:42.869 19:20:29 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:13:42.869 19:20:29 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:13:42.869 19:20:29 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:13:42.869 19:20:29 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:13:42.869 nvmf_trace.0 00:13:42.869 19:20:29 -- common/autotest_common.sh@809 -- # return 0 00:13:42.869 19:20:29 -- target/zcopy.sh@1 -- # nvmftestfini 00:13:42.869 19:20:29 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:42.869 19:20:29 -- nvmf/common.sh@117 -- # sync 00:13:42.869 19:20:29 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:42.869 19:20:29 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:42.869 19:20:29 -- nvmf/common.sh@120 -- # set +e 00:13:42.869 19:20:29 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:42.869 19:20:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:42.869 rmmod nvme_rdma 00:13:42.869 rmmod nvme_fabrics 00:13:42.869 19:20:29 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:42.869 19:20:29 -- nvmf/common.sh@124 -- # set -e 00:13:42.869 19:20:29 -- nvmf/common.sh@125 -- # return 0 00:13:42.869 19:20:29 -- nvmf/common.sh@478 -- # '[' -n 3002549 ']' 00:13:42.869 19:20:29 -- nvmf/common.sh@479 -- # killprocess 3002549 00:13:42.869 19:20:29 -- common/autotest_common.sh@936 -- # '[' -z 3002549 ']' 00:13:42.869 19:20:29 -- common/autotest_common.sh@940 -- # kill -0 3002549 00:13:42.869 19:20:29 -- common/autotest_common.sh@941 -- # uname 00:13:42.869 19:20:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:42.869 19:20:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3002549 00:13:42.869 19:20:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:42.869 19:20:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:42.869 19:20:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3002549' 00:13:42.869 killing process with pid 3002549 00:13:42.869 19:20:29 -- common/autotest_common.sh@955 -- # kill 3002549 00:13:42.869 19:20:29 -- common/autotest_common.sh@960 -- # wait 3002549 00:13:43.128 19:20:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:43.128 19:20:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:43.128 00:13:43.128 real 0m7.320s 00:13:43.128 user 0m3.233s 00:13:43.128 sys 0m4.809s 00:13:43.128 19:20:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:43.128 19:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:43.128 ************************************ 00:13:43.128 END TEST nvmf_zcopy 00:13:43.128 ************************************ 00:13:43.128 19:20:30 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:13:43.128 19:20:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.128 19:20:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.128 19:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:43.388 ************************************ 00:13:43.388 START TEST nvmf_nmic 00:13:43.388 ************************************ 00:13:43.388 19:20:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:13:43.388 * Looking for test storage... 00:13:43.388 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:43.388 19:20:30 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.388 19:20:30 -- nvmf/common.sh@7 -- # uname -s 00:13:43.388 19:20:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.388 19:20:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.388 19:20:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.388 19:20:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.388 19:20:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.388 19:20:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.388 19:20:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.388 19:20:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.388 19:20:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.388 19:20:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.388 19:20:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:43.388 19:20:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:43.388 19:20:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.388 19:20:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.388 19:20:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.388 19:20:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:43.388 19:20:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:43.388 19:20:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.388 19:20:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.388 19:20:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.388 19:20:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.388 19:20:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.388 19:20:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.388 19:20:30 -- paths/export.sh@5 -- # export PATH 00:13:43.388 19:20:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.388 19:20:30 -- nvmf/common.sh@47 -- # : 0 00:13:43.388 19:20:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:43.388 19:20:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:43.388 19:20:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:43.388 19:20:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.648 19:20:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.648 19:20:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:43.648 19:20:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:43.648 19:20:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:43.648 19:20:30 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:43.648 19:20:30 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:43.648 19:20:30 -- target/nmic.sh@14 -- # nvmftestinit 00:13:43.648 19:20:30 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:43.648 19:20:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.648 19:20:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:43.648 19:20:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:43.648 19:20:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:43.648 19:20:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.648 19:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.648 19:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.648 19:20:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:43.648 19:20:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:43.648 19:20:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:43.648 19:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:50.225 19:20:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:50.225 19:20:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:50.225 19:20:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:50.225 19:20:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:50.225 19:20:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:50.225 19:20:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:50.225 19:20:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:50.225 19:20:36 -- nvmf/common.sh@295 -- # net_devs=() 00:13:50.225 19:20:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:50.225 19:20:36 -- nvmf/common.sh@296 -- # e810=() 00:13:50.225 19:20:36 -- nvmf/common.sh@296 -- # local -ga e810 00:13:50.225 19:20:36 -- nvmf/common.sh@297 -- # x722=() 00:13:50.225 19:20:36 -- nvmf/common.sh@297 -- # local -ga x722 00:13:50.225 19:20:36 -- nvmf/common.sh@298 -- # mlx=() 00:13:50.225 19:20:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:50.225 19:20:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:50.225 19:20:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:50.225 19:20:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:50.225 19:20:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:50.225 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:50.225 19:20:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:50.225 19:20:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:50.225 19:20:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:50.225 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:50.225 19:20:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:50.225 19:20:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:50.225 19:20:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:50.225 19:20:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.225 19:20:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:50.225 19:20:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.225 19:20:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:50.225 Found net devices under 0000:18:00.0: mlx_0_0 00:13:50.225 19:20:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:50.225 19:20:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.225 19:20:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:50.225 19:20:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.225 19:20:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:50.225 Found net devices under 0000:18:00.1: mlx_0_1 00:13:50.225 19:20:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.225 19:20:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:50.225 19:20:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:50.225 19:20:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:50.225 19:20:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:50.225 19:20:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:50.225 19:20:36 -- nvmf/common.sh@58 -- # uname 00:13:50.225 19:20:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:50.225 19:20:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:50.225 19:20:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:50.226 19:20:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:50.226 19:20:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:50.226 19:20:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:50.226 19:20:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:50.226 19:20:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:50.226 19:20:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:50.226 19:20:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:50.226 19:20:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:50.226 19:20:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:50.226 19:20:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:50.226 19:20:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:50.226 19:20:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:50.226 19:20:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:50.226 19:20:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@105 -- # continue 2 00:13:50.226 19:20:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@105 -- # continue 2 00:13:50.226 19:20:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:50.226 19:20:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.226 19:20:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:50.226 19:20:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:50.226 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:50.226 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:13:50.226 altname enp24s0f0np0 00:13:50.226 altname ens785f0np0 00:13:50.226 inet 192.168.100.8/24 scope global mlx_0_0 00:13:50.226 valid_lft forever preferred_lft forever 00:13:50.226 19:20:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:50.226 19:20:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.226 19:20:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:50.226 19:20:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:50.226 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:50.226 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:13:50.226 altname enp24s0f1np1 00:13:50.226 altname ens785f1np1 00:13:50.226 inet 192.168.100.9/24 scope global mlx_0_1 00:13:50.226 valid_lft forever preferred_lft forever 00:13:50.226 19:20:36 -- nvmf/common.sh@411 -- # return 0 00:13:50.226 19:20:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:50.226 19:20:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:50.226 19:20:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:50.226 19:20:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:50.226 19:20:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:50.226 19:20:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:50.226 19:20:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:50.226 19:20:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:50.226 19:20:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:50.226 19:20:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@105 -- # continue 2 00:13:50.226 19:20:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.226 19:20:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:50.226 19:20:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@105 -- # continue 2 00:13:50.226 19:20:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:50.226 19:20:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.226 19:20:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:50.226 19:20:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.226 19:20:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.226 19:20:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:50.226 192.168.100.9' 00:13:50.226 19:20:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:50.226 192.168.100.9' 00:13:50.226 19:20:36 -- nvmf/common.sh@446 -- # head -n 1 00:13:50.226 19:20:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:50.226 19:20:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:50.226 192.168.100.9' 00:13:50.226 19:20:36 -- nvmf/common.sh@447 -- # head -n 1 00:13:50.226 19:20:36 -- nvmf/common.sh@447 -- # tail -n +2 00:13:50.226 19:20:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:50.226 19:20:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:50.226 19:20:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:50.226 19:20:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:50.226 19:20:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:50.226 19:20:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:50.226 19:20:36 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:13:50.226 19:20:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:50.226 19:20:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:50.226 19:20:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.226 19:20:36 -- nvmf/common.sh@470 -- # nvmfpid=3005654 00:13:50.226 19:20:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:50.226 19:20:36 -- nvmf/common.sh@471 -- # waitforlisten 3005654 00:13:50.226 19:20:36 -- common/autotest_common.sh@817 -- # '[' -z 3005654 ']' 00:13:50.226 19:20:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:50.226 19:20:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:50.226 19:20:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:50.226 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:50.226 19:20:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:50.226 19:20:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.226 [2024-04-24 19:20:36.579385] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:13:50.226 [2024-04-24 19:20:36.579447] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:50.226 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.226 [2024-04-24 19:20:36.651005] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:50.226 [2024-04-24 19:20:36.738954] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:50.226 [2024-04-24 19:20:36.739010] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:50.226 [2024-04-24 19:20:36.739020] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:50.226 [2024-04-24 19:20:36.739029] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:50.226 [2024-04-24 19:20:36.739037] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:50.226 [2024-04-24 19:20:36.739100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.226 [2024-04-24 19:20:36.739186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:50.226 [2024-04-24 19:20:36.739248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:50.226 [2024-04-24 19:20:36.739250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.486 19:20:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:50.486 19:20:37 -- common/autotest_common.sh@850 -- # return 0 00:13:50.486 19:20:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:50.486 19:20:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:50.486 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.486 19:20:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.486 19:20:37 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:50.486 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.486 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.486 [2024-04-24 19:20:37.460389] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2242240/0x2246730) succeed. 00:13:50.486 [2024-04-24 19:20:37.470982] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2243880/0x2287dc0) succeed. 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 Malloc0 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 [2024-04-24 19:20:37.640591] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:13:50.746 test case1: single bdev can't be used in multiple subsystems 00:13:50.746 19:20:37 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@28 -- # nmic_status=0 00:13:50.746 19:20:37 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 [2024-04-24 19:20:37.664338] bdev.c:7988:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:13:50.746 [2024-04-24 19:20:37.664361] subsystem.c:1934:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:13:50.746 [2024-04-24 19:20:37.664371] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:50.746 request: 00:13:50.746 { 00:13:50.746 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:13:50.746 "namespace": { 00:13:50.746 "bdev_name": "Malloc0", 00:13:50.746 "no_auto_visible": false 00:13:50.746 }, 00:13:50.746 "method": "nvmf_subsystem_add_ns", 00:13:50.746 "req_id": 1 00:13:50.746 } 00:13:50.746 Got JSON-RPC error response 00:13:50.746 response: 00:13:50.746 { 00:13:50.746 "code": -32602, 00:13:50.746 "message": "Invalid parameters" 00:13:50.746 } 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@29 -- # nmic_status=1 00:13:50.746 19:20:37 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:13:50.746 19:20:37 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:13:50.746 Adding namespace failed - expected result. 00:13:50.746 19:20:37 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:13:50.746 test case2: host connect to nvmf target in multiple paths 00:13:50.746 19:20:37 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:13:50.746 19:20:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.746 19:20:37 -- common/autotest_common.sh@10 -- # set +x 00:13:50.746 [2024-04-24 19:20:37.676402] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:13:50.746 19:20:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.746 19:20:37 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:13:51.683 19:20:38 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:13:52.618 19:20:39 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:13:52.618 19:20:39 -- common/autotest_common.sh@1184 -- # local i=0 00:13:52.618 19:20:39 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:52.618 19:20:39 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:13:52.618 19:20:39 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:55.155 19:20:41 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:55.155 19:20:41 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:55.155 19:20:41 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:55.155 19:20:41 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:13:55.155 19:20:41 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:55.155 19:20:41 -- common/autotest_common.sh@1194 -- # return 0 00:13:55.155 19:20:41 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:13:55.155 [global] 00:13:55.155 thread=1 00:13:55.155 invalidate=1 00:13:55.155 rw=write 00:13:55.155 time_based=1 00:13:55.155 runtime=1 00:13:55.155 ioengine=libaio 00:13:55.155 direct=1 00:13:55.155 bs=4096 00:13:55.155 iodepth=1 00:13:55.155 norandommap=0 00:13:55.155 numjobs=1 00:13:55.155 00:13:55.155 verify_dump=1 00:13:55.155 verify_backlog=512 00:13:55.155 verify_state_save=0 00:13:55.155 do_verify=1 00:13:55.155 verify=crc32c-intel 00:13:55.155 [job0] 00:13:55.155 filename=/dev/nvme0n1 00:13:55.155 Could not set queue depth (nvme0n1) 00:13:55.155 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:55.155 fio-3.35 00:13:55.155 Starting 1 thread 00:13:56.091 00:13:56.091 job0: (groupid=0, jobs=1): err= 0: pid=3006515: Wed Apr 24 19:20:43 2024 00:13:56.091 read: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec) 00:13:56.091 slat (nsec): min=8334, max=44280, avg=8906.45, stdev=1049.93 00:13:56.091 clat (usec): min=41, max=290, avg=63.19, stdev= 4.73 00:13:56.091 lat (usec): min=63, max=300, avg=72.10, stdev= 4.83 00:13:56.091 clat percentiles (usec): 00:13:56.091 | 1.00th=[ 57], 5.00th=[ 58], 10.00th=[ 59], 20.00th=[ 61], 00:13:56.091 | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 63], 60.00th=[ 64], 00:13:56.091 | 70.00th=[ 65], 80.00th=[ 67], 90.00th=[ 69], 95.00th=[ 70], 00:13:56.091 | 99.00th=[ 74], 99.50th=[ 76], 99.90th=[ 81], 99.95th=[ 91], 00:13:56.091 | 99.99th=[ 293] 00:13:56.091 write: IOPS=6922, BW=27.0MiB/s (28.4MB/s)(27.1MiB/1001msec); 0 zone resets 00:13:56.091 slat (nsec): min=10385, max=83760, avg=11118.16, stdev=1377.59 00:13:56.091 clat (usec): min=46, max=132, avg=59.98, stdev= 3.83 00:13:56.091 lat (usec): min=61, max=162, avg=71.10, stdev= 4.12 00:13:56.091 clat percentiles (usec): 00:13:56.091 | 1.00th=[ 53], 5.00th=[ 55], 10.00th=[ 56], 20.00th=[ 57], 00:13:56.091 | 30.00th=[ 58], 40.00th=[ 59], 50.00th=[ 60], 60.00th=[ 61], 00:13:56.091 | 70.00th=[ 62], 80.00th=[ 64], 90.00th=[ 65], 95.00th=[ 67], 00:13:56.091 | 99.00th=[ 71], 99.50th=[ 73], 99.90th=[ 78], 99.95th=[ 81], 00:13:56.091 | 99.99th=[ 133] 00:13:56.091 bw ( KiB/s): min=28672, max=28672, per=100.00%, avg=28672.00, stdev= 0.00, samples=1 00:13:56.091 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:13:56.091 lat (usec) : 50=0.05%, 100=99.92%, 250=0.02%, 500=0.01% 00:13:56.091 cpu : usr=7.60%, sys=14.20%, ctx=13586, majf=0, minf=1 00:13:56.091 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:56.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:56.091 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:56.091 issued rwts: total=6656,6929,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:56.091 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:56.091 00:13:56.091 Run status group 0 (all jobs): 00:13:56.091 READ: bw=26.0MiB/s (27.2MB/s), 26.0MiB/s-26.0MiB/s (27.2MB/s-27.2MB/s), io=26.0MiB (27.3MB), run=1001-1001msec 00:13:56.091 WRITE: bw=27.0MiB/s (28.4MB/s), 27.0MiB/s-27.0MiB/s (28.4MB/s-28.4MB/s), io=27.1MiB (28.4MB), run=1001-1001msec 00:13:56.091 00:13:56.091 Disk stats (read/write): 00:13:56.091 nvme0n1: ios=6114/6144, merge=0/0, ticks=353/350, in_queue=703, util=90.78% 00:13:56.350 19:20:43 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:58.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:13:58.295 19:20:45 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:58.295 19:20:45 -- common/autotest_common.sh@1205 -- # local i=0 00:13:58.295 19:20:45 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:13:58.295 19:20:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:58.295 19:20:45 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:13:58.295 19:20:45 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:58.295 19:20:45 -- common/autotest_common.sh@1217 -- # return 0 00:13:58.295 19:20:45 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:13:58.295 19:20:45 -- target/nmic.sh@53 -- # nvmftestfini 00:13:58.295 19:20:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:58.295 19:20:45 -- nvmf/common.sh@117 -- # sync 00:13:58.295 19:20:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:58.295 19:20:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:58.295 19:20:45 -- nvmf/common.sh@120 -- # set +e 00:13:58.295 19:20:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:58.295 19:20:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:58.295 rmmod nvme_rdma 00:13:58.295 rmmod nvme_fabrics 00:13:58.295 19:20:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:58.295 19:20:45 -- nvmf/common.sh@124 -- # set -e 00:13:58.295 19:20:45 -- nvmf/common.sh@125 -- # return 0 00:13:58.295 19:20:45 -- nvmf/common.sh@478 -- # '[' -n 3005654 ']' 00:13:58.295 19:20:45 -- nvmf/common.sh@479 -- # killprocess 3005654 00:13:58.295 19:20:45 -- common/autotest_common.sh@936 -- # '[' -z 3005654 ']' 00:13:58.295 19:20:45 -- common/autotest_common.sh@940 -- # kill -0 3005654 00:13:58.295 19:20:45 -- common/autotest_common.sh@941 -- # uname 00:13:58.295 19:20:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:58.295 19:20:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3005654 00:13:58.295 19:20:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:58.295 19:20:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:58.295 19:20:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3005654' 00:13:58.295 killing process with pid 3005654 00:13:58.295 19:20:45 -- common/autotest_common.sh@955 -- # kill 3005654 00:13:58.295 19:20:45 -- common/autotest_common.sh@960 -- # wait 3005654 00:13:58.295 [2024-04-24 19:20:45.283421] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:58.554 19:20:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:58.554 19:20:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:58.554 00:13:58.554 real 0m15.260s 00:13:58.554 user 0m39.213s 00:13:58.554 sys 0m5.728s 00:13:58.554 19:20:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:58.554 19:20:45 -- common/autotest_common.sh@10 -- # set +x 00:13:58.554 ************************************ 00:13:58.554 END TEST nvmf_nmic 00:13:58.554 ************************************ 00:13:58.813 19:20:45 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:13:58.813 19:20:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:58.813 19:20:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:58.813 19:20:45 -- common/autotest_common.sh@10 -- # set +x 00:13:58.813 ************************************ 00:13:58.813 START TEST nvmf_fio_target 00:13:58.813 ************************************ 00:13:58.813 19:20:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:13:59.072 * Looking for test storage... 00:13:59.072 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:59.072 19:20:45 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:59.072 19:20:45 -- nvmf/common.sh@7 -- # uname -s 00:13:59.072 19:20:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:59.072 19:20:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:59.072 19:20:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:59.072 19:20:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:59.072 19:20:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:59.072 19:20:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:59.072 19:20:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:59.072 19:20:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:59.072 19:20:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:59.072 19:20:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:59.072 19:20:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:13:59.072 19:20:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:13:59.072 19:20:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:59.072 19:20:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:59.072 19:20:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:59.072 19:20:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:59.072 19:20:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:59.072 19:20:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:59.072 19:20:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:59.072 19:20:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:59.072 19:20:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.072 19:20:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.072 19:20:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.072 19:20:45 -- paths/export.sh@5 -- # export PATH 00:13:59.073 19:20:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.073 19:20:45 -- nvmf/common.sh@47 -- # : 0 00:13:59.073 19:20:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:59.073 19:20:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:59.073 19:20:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:59.073 19:20:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:59.073 19:20:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:59.073 19:20:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:59.073 19:20:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:59.073 19:20:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:59.073 19:20:45 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:59.073 19:20:45 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:59.073 19:20:45 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:59.073 19:20:45 -- target/fio.sh@16 -- # nvmftestinit 00:13:59.073 19:20:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:59.073 19:20:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:59.073 19:20:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:59.073 19:20:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:59.073 19:20:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:59.073 19:20:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.073 19:20:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.073 19:20:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.073 19:20:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:59.073 19:20:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:59.073 19:20:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:59.073 19:20:45 -- common/autotest_common.sh@10 -- # set +x 00:14:04.429 19:20:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:04.429 19:20:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:04.429 19:20:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:04.429 19:20:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:04.429 19:20:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:04.429 19:20:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:04.429 19:20:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:04.429 19:20:51 -- nvmf/common.sh@295 -- # net_devs=() 00:14:04.429 19:20:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:04.429 19:20:51 -- nvmf/common.sh@296 -- # e810=() 00:14:04.430 19:20:51 -- nvmf/common.sh@296 -- # local -ga e810 00:14:04.430 19:20:51 -- nvmf/common.sh@297 -- # x722=() 00:14:04.430 19:20:51 -- nvmf/common.sh@297 -- # local -ga x722 00:14:04.430 19:20:51 -- nvmf/common.sh@298 -- # mlx=() 00:14:04.430 19:20:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:04.430 19:20:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:04.430 19:20:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:04.430 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:04.430 19:20:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.430 19:20:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:04.430 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:04.430 19:20:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.430 19:20:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.430 19:20:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.430 19:20:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:04.430 Found net devices under 0000:18:00.0: mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.430 19:20:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.430 19:20:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:04.430 Found net devices under 0000:18:00.1: mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.430 19:20:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:04.430 19:20:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:04.430 19:20:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:04.430 19:20:51 -- nvmf/common.sh@58 -- # uname 00:14:04.430 19:20:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:04.430 19:20:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:04.430 19:20:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:04.430 19:20:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:04.430 19:20:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:04.430 19:20:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:04.430 19:20:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:04.430 19:20:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:04.430 19:20:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:04.430 19:20:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:04.430 19:20:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:04.430 19:20:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.430 19:20:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.430 19:20:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.430 19:20:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.430 19:20:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@105 -- # continue 2 00:14:04.430 19:20:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@105 -- # continue 2 00:14:04.430 19:20:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.430 19:20:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.430 19:20:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:04.430 19:20:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:04.430 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:04.430 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:14:04.430 altname enp24s0f0np0 00:14:04.430 altname ens785f0np0 00:14:04.430 inet 192.168.100.8/24 scope global mlx_0_0 00:14:04.430 valid_lft forever preferred_lft forever 00:14:04.430 19:20:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.430 19:20:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.430 19:20:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:04.430 19:20:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:04.430 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:04.430 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:14:04.430 altname enp24s0f1np1 00:14:04.430 altname ens785f1np1 00:14:04.430 inet 192.168.100.9/24 scope global mlx_0_1 00:14:04.430 valid_lft forever preferred_lft forever 00:14:04.430 19:20:51 -- nvmf/common.sh@411 -- # return 0 00:14:04.430 19:20:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:04.430 19:20:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:04.430 19:20:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:04.430 19:20:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:04.430 19:20:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.430 19:20:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.430 19:20:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.430 19:20:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.430 19:20:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.430 19:20:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@105 -- # continue 2 00:14:04.430 19:20:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.430 19:20:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:04.430 19:20:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@105 -- # continue 2 00:14:04.430 19:20:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.430 19:20:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.430 19:20:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.430 19:20:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.430 19:20:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:04.431 19:20:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.431 19:20:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:04.431 192.168.100.9' 00:14:04.431 19:20:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:04.431 192.168.100.9' 00:14:04.431 19:20:51 -- nvmf/common.sh@446 -- # head -n 1 00:14:04.431 19:20:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:04.431 19:20:51 -- nvmf/common.sh@447 -- # tail -n +2 00:14:04.431 19:20:51 -- nvmf/common.sh@447 -- # head -n 1 00:14:04.431 19:20:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:04.431 192.168.100.9' 00:14:04.431 19:20:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:04.431 19:20:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:04.431 19:20:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:04.431 19:20:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:04.431 19:20:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:04.431 19:20:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:04.431 19:20:51 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:14:04.431 19:20:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:04.431 19:20:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:04.431 19:20:51 -- common/autotest_common.sh@10 -- # set +x 00:14:04.431 19:20:51 -- nvmf/common.sh@470 -- # nvmfpid=3009631 00:14:04.431 19:20:51 -- nvmf/common.sh@471 -- # waitforlisten 3009631 00:14:04.431 19:20:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:04.431 19:20:51 -- common/autotest_common.sh@817 -- # '[' -z 3009631 ']' 00:14:04.431 19:20:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:04.431 19:20:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:04.431 19:20:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:04.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:04.431 19:20:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:04.431 19:20:51 -- common/autotest_common.sh@10 -- # set +x 00:14:04.431 [2024-04-24 19:20:51.268491] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:14:04.431 [2024-04-24 19:20:51.268542] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:04.431 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.431 [2024-04-24 19:20:51.339753] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:04.431 [2024-04-24 19:20:51.428939] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:04.431 [2024-04-24 19:20:51.428978] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:04.431 [2024-04-24 19:20:51.428989] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:04.431 [2024-04-24 19:20:51.428998] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:04.431 [2024-04-24 19:20:51.429006] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:04.431 [2024-04-24 19:20:51.429075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:04.431 [2024-04-24 19:20:51.429105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:04.431 [2024-04-24 19:20:51.429194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:04.431 [2024-04-24 19:20:51.429195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:05.365 19:20:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:05.365 19:20:52 -- common/autotest_common.sh@850 -- # return 0 00:14:05.365 19:20:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:05.365 19:20:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:05.365 19:20:52 -- common/autotest_common.sh@10 -- # set +x 00:14:05.365 19:20:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:05.365 19:20:52 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:05.365 [2024-04-24 19:20:52.314901] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c81240/0x1c85730) succeed. 00:14:05.365 [2024-04-24 19:20:52.325226] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c82880/0x1cc6dc0) succeed. 00:14:05.623 19:20:52 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:05.882 19:20:52 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:14:05.882 19:20:52 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:05.882 19:20:52 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:14:05.882 19:20:52 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:06.141 19:20:53 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:14:06.141 19:20:53 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:06.401 19:20:53 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:14:06.401 19:20:53 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:14:06.660 19:20:53 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:06.918 19:20:53 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:14:06.918 19:20:53 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:06.918 19:20:53 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:14:06.918 19:20:53 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:07.176 19:20:54 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:14:07.176 19:20:54 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:14:07.434 19:20:54 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:07.693 19:20:54 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:14:07.693 19:20:54 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:07.693 19:20:54 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:14:07.693 19:20:54 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:07.952 19:20:54 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:08.212 [2024-04-24 19:20:55.012748] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:08.212 19:20:55 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:14:08.212 19:20:55 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:14:08.471 19:20:55 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:09.410 19:20:56 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:14:09.410 19:20:56 -- common/autotest_common.sh@1184 -- # local i=0 00:14:09.410 19:20:56 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:09.410 19:20:56 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:14:09.410 19:20:56 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:14:09.410 19:20:56 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:11.944 19:20:58 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:11.944 19:20:58 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:11.944 19:20:58 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:11.944 19:20:58 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:14:11.944 19:20:58 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:11.944 19:20:58 -- common/autotest_common.sh@1194 -- # return 0 00:14:11.944 19:20:58 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:14:11.944 [global] 00:14:11.944 thread=1 00:14:11.944 invalidate=1 00:14:11.944 rw=write 00:14:11.944 time_based=1 00:14:11.944 runtime=1 00:14:11.944 ioengine=libaio 00:14:11.944 direct=1 00:14:11.944 bs=4096 00:14:11.944 iodepth=1 00:14:11.944 norandommap=0 00:14:11.944 numjobs=1 00:14:11.944 00:14:11.944 verify_dump=1 00:14:11.944 verify_backlog=512 00:14:11.944 verify_state_save=0 00:14:11.944 do_verify=1 00:14:11.944 verify=crc32c-intel 00:14:11.944 [job0] 00:14:11.944 filename=/dev/nvme0n1 00:14:11.944 [job1] 00:14:11.944 filename=/dev/nvme0n2 00:14:11.944 [job2] 00:14:11.944 filename=/dev/nvme0n3 00:14:11.944 [job3] 00:14:11.944 filename=/dev/nvme0n4 00:14:11.944 Could not set queue depth (nvme0n1) 00:14:11.944 Could not set queue depth (nvme0n2) 00:14:11.944 Could not set queue depth (nvme0n3) 00:14:11.944 Could not set queue depth (nvme0n4) 00:14:11.944 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:11.944 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:11.944 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:11.944 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:11.944 fio-3.35 00:14:11.944 Starting 4 threads 00:14:13.321 00:14:13.321 job0: (groupid=0, jobs=1): err= 0: pid=3010890: Wed Apr 24 19:20:59 2024 00:14:13.321 read: IOPS=3340, BW=13.0MiB/s (13.7MB/s)(13.1MiB/1001msec) 00:14:13.321 slat (nsec): min=8432, max=34323, avg=9455.15, stdev=1211.14 00:14:13.321 clat (usec): min=72, max=412, avg=135.49, stdev=24.22 00:14:13.321 lat (usec): min=81, max=421, avg=144.94, stdev=24.42 00:14:13.321 clat percentiles (usec): 00:14:13.321 | 1.00th=[ 81], 5.00th=[ 87], 10.00th=[ 91], 20.00th=[ 127], 00:14:13.321 | 30.00th=[ 135], 40.00th=[ 139], 50.00th=[ 141], 60.00th=[ 145], 00:14:13.321 | 70.00th=[ 149], 80.00th=[ 151], 90.00th=[ 157], 95.00th=[ 165], 00:14:13.321 | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 206], 99.95th=[ 217], 00:14:13.321 | 99.99th=[ 412] 00:14:13.321 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:14:13.321 slat (nsec): min=10361, max=50421, avg=11580.90, stdev=1659.60 00:14:13.321 clat (usec): min=63, max=294, avg=128.23, stdev=23.69 00:14:13.321 lat (usec): min=76, max=305, avg=139.82, stdev=23.78 00:14:13.321 clat percentiles (usec): 00:14:13.321 | 1.00th=[ 73], 5.00th=[ 79], 10.00th=[ 84], 20.00th=[ 121], 00:14:13.321 | 30.00th=[ 127], 40.00th=[ 130], 50.00th=[ 133], 60.00th=[ 137], 00:14:13.322 | 70.00th=[ 139], 80.00th=[ 143], 90.00th=[ 151], 95.00th=[ 161], 00:14:13.322 | 99.00th=[ 178], 99.50th=[ 182], 99.90th=[ 196], 99.95th=[ 265], 00:14:13.322 | 99.99th=[ 293] 00:14:13.322 bw ( KiB/s): min=14976, max=14976, per=23.28%, avg=14976.00, stdev= 0.00, samples=1 00:14:13.322 iops : min= 3744, max= 3744, avg=3744.00, stdev= 0.00, samples=1 00:14:13.322 lat (usec) : 100=15.91%, 250=84.05%, 500=0.04% 00:14:13.322 cpu : usr=3.30%, sys=8.50%, ctx=6929, majf=0, minf=1 00:14:13.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:13.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 issued rwts: total=3344,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:13.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:13.322 job1: (groupid=0, jobs=1): err= 0: pid=3010891: Wed Apr 24 19:20:59 2024 00:14:13.322 read: IOPS=3074, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:14:13.322 slat (nsec): min=8526, max=22069, avg=9532.17, stdev=1085.72 00:14:13.322 clat (usec): min=71, max=405, avg=142.00, stdev=17.01 00:14:13.322 lat (usec): min=80, max=421, avg=151.53, stdev=17.15 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 83], 5.00th=[ 116], 10.00th=[ 126], 20.00th=[ 133], 00:14:13.322 | 30.00th=[ 137], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 147], 00:14:13.322 | 70.00th=[ 149], 80.00th=[ 153], 90.00th=[ 159], 95.00th=[ 167], 00:14:13.322 | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 200], 99.95th=[ 208], 00:14:13.322 | 99.99th=[ 404] 00:14:13.322 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:14:13.322 slat (nsec): min=10542, max=44997, avg=11664.50, stdev=1316.57 00:14:13.322 clat (usec): min=64, max=204, avg=133.41, stdev=16.52 00:14:13.322 lat (usec): min=75, max=215, avg=145.07, stdev=16.59 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 78], 5.00th=[ 106], 10.00th=[ 118], 20.00th=[ 125], 00:14:13.322 | 30.00th=[ 129], 40.00th=[ 133], 50.00th=[ 135], 60.00th=[ 137], 00:14:13.322 | 70.00th=[ 139], 80.00th=[ 143], 90.00th=[ 151], 95.00th=[ 161], 00:14:13.322 | 99.00th=[ 178], 99.50th=[ 186], 99.90th=[ 196], 99.95th=[ 200], 00:14:13.322 | 99.99th=[ 204] 00:14:13.322 bw ( KiB/s): min=14080, max=14080, per=21.89%, avg=14080.00, stdev= 0.00, samples=1 00:14:13.322 iops : min= 3520, max= 3520, avg=3520.00, stdev= 0.00, samples=1 00:14:13.322 lat (usec) : 100=3.29%, 250=96.70%, 500=0.02% 00:14:13.322 cpu : usr=4.10%, sys=7.30%, ctx=6662, majf=0, minf=1 00:14:13.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:13.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 issued rwts: total=3078,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:13.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:13.322 job2: (groupid=0, jobs=1): err= 0: pid=3010892: Wed Apr 24 19:20:59 2024 00:14:13.322 read: IOPS=3069, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:14:13.322 slat (nsec): min=8591, max=27896, avg=9615.19, stdev=1086.63 00:14:13.322 clat (usec): min=77, max=396, avg=142.37, stdev=15.85 00:14:13.322 lat (usec): min=86, max=405, avg=151.99, stdev=15.97 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 91], 5.00th=[ 117], 10.00th=[ 126], 20.00th=[ 135], 00:14:13.322 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 147], 00:14:13.322 | 70.00th=[ 149], 80.00th=[ 153], 90.00th=[ 159], 95.00th=[ 165], 00:14:13.322 | 99.00th=[ 184], 99.50th=[ 190], 99.90th=[ 198], 99.95th=[ 202], 00:14:13.322 | 99.99th=[ 396] 00:14:13.322 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:14:13.322 slat (nsec): min=10729, max=46964, avg=11895.21, stdev=1559.74 00:14:13.322 clat (usec): min=69, max=199, avg=132.93, stdev=15.65 00:14:13.322 lat (usec): min=80, max=211, avg=144.83, stdev=15.76 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 83], 5.00th=[ 108], 10.00th=[ 118], 20.00th=[ 125], 00:14:13.322 | 30.00th=[ 128], 40.00th=[ 131], 50.00th=[ 135], 60.00th=[ 137], 00:14:13.322 | 70.00th=[ 139], 80.00th=[ 143], 90.00th=[ 149], 95.00th=[ 157], 00:14:13.322 | 99.00th=[ 178], 99.50th=[ 186], 99.90th=[ 194], 99.95th=[ 198], 00:14:13.322 | 99.99th=[ 200] 00:14:13.322 bw ( KiB/s): min=14200, max=14200, per=22.08%, avg=14200.00, stdev= 0.00, samples=1 00:14:13.322 iops : min= 3550, max= 3550, avg=3550.00, stdev= 0.00, samples=1 00:14:13.322 lat (usec) : 100=2.90%, 250=97.09%, 500=0.02% 00:14:13.322 cpu : usr=4.20%, sys=7.30%, ctx=6658, majf=0, minf=1 00:14:13.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:13.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 issued rwts: total=3073,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:13.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:13.322 job3: (groupid=0, jobs=1): err= 0: pid=3010893: Wed Apr 24 19:20:59 2024 00:14:13.322 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:14:13.322 slat (nsec): min=8466, max=25191, avg=9220.03, stdev=842.82 00:14:13.322 clat (usec): min=62, max=118, avg=85.56, stdev= 5.70 00:14:13.322 lat (usec): min=71, max=127, avg=94.78, stdev= 5.75 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 76], 5.00th=[ 78], 10.00th=[ 80], 20.00th=[ 81], 00:14:13.322 | 30.00th=[ 83], 40.00th=[ 84], 50.00th=[ 85], 60.00th=[ 87], 00:14:13.322 | 70.00th=[ 88], 80.00th=[ 90], 90.00th=[ 93], 95.00th=[ 96], 00:14:13.322 | 99.00th=[ 102], 99.50th=[ 105], 99.90th=[ 112], 99.95th=[ 112], 00:14:13.322 | 99.99th=[ 119] 00:14:13.322 write: IOPS=5339, BW=20.9MiB/s (21.9MB/s)(20.9MiB/1001msec); 0 zone resets 00:14:13.322 slat (nsec): min=10671, max=42915, avg=11411.39, stdev=1136.63 00:14:13.322 clat (usec): min=63, max=120, avg=80.85, stdev= 5.37 00:14:13.322 lat (usec): min=78, max=148, avg=92.26, stdev= 5.52 00:14:13.322 clat percentiles (usec): 00:14:13.322 | 1.00th=[ 72], 5.00th=[ 74], 10.00th=[ 75], 20.00th=[ 77], 00:14:13.322 | 30.00th=[ 78], 40.00th=[ 80], 50.00th=[ 81], 60.00th=[ 82], 00:14:13.322 | 70.00th=[ 84], 80.00th=[ 85], 90.00th=[ 88], 95.00th=[ 91], 00:14:13.322 | 99.00th=[ 97], 99.50th=[ 99], 99.90th=[ 105], 99.95th=[ 110], 00:14:13.322 | 99.99th=[ 121] 00:14:13.322 bw ( KiB/s): min=21208, max=21208, per=32.97%, avg=21208.00, stdev= 0.00, samples=1 00:14:13.322 iops : min= 5302, max= 5302, avg=5302.00, stdev= 0.00, samples=1 00:14:13.322 lat (usec) : 100=98.94%, 250=1.06% 00:14:13.322 cpu : usr=6.20%, sys=11.30%, ctx=10465, majf=0, minf=1 00:14:13.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:13.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:13.322 issued rwts: total=5120,5345,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:13.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:13.322 00:14:13.322 Run status group 0 (all jobs): 00:14:13.322 READ: bw=57.0MiB/s (59.8MB/s), 12.0MiB/s-20.0MiB/s (12.6MB/s-20.9MB/s), io=57.1MiB (59.9MB), run=1001-1001msec 00:14:13.322 WRITE: bw=62.8MiB/s (65.9MB/s), 14.0MiB/s-20.9MiB/s (14.7MB/s-21.9MB/s), io=62.9MiB (65.9MB), run=1001-1001msec 00:14:13.322 00:14:13.322 Disk stats (read/write): 00:14:13.322 nvme0n1: ios=2610/2954, merge=0/0, ticks=369/360, in_queue=729, util=83.07% 00:14:13.322 nvme0n2: ios=2560/2843, merge=0/0, ticks=349/367, in_queue=716, util=84.41% 00:14:13.322 nvme0n3: ios=2560/2851, merge=0/0, ticks=360/359, in_queue=719, util=88.12% 00:14:13.322 nvme0n4: ios=4096/4527, merge=0/0, ticks=320/339, in_queue=659, util=89.36% 00:14:13.322 19:20:59 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:14:13.322 [global] 00:14:13.322 thread=1 00:14:13.322 invalidate=1 00:14:13.322 rw=randwrite 00:14:13.322 time_based=1 00:14:13.322 runtime=1 00:14:13.322 ioengine=libaio 00:14:13.322 direct=1 00:14:13.322 bs=4096 00:14:13.322 iodepth=1 00:14:13.322 norandommap=0 00:14:13.322 numjobs=1 00:14:13.322 00:14:13.322 verify_dump=1 00:14:13.322 verify_backlog=512 00:14:13.322 verify_state_save=0 00:14:13.322 do_verify=1 00:14:13.322 verify=crc32c-intel 00:14:13.322 [job0] 00:14:13.322 filename=/dev/nvme0n1 00:14:13.322 [job1] 00:14:13.322 filename=/dev/nvme0n2 00:14:13.322 [job2] 00:14:13.322 filename=/dev/nvme0n3 00:14:13.322 [job3] 00:14:13.322 filename=/dev/nvme0n4 00:14:13.322 Could not set queue depth (nvme0n1) 00:14:13.322 Could not set queue depth (nvme0n2) 00:14:13.322 Could not set queue depth (nvme0n3) 00:14:13.322 Could not set queue depth (nvme0n4) 00:14:13.581 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:13.581 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:13.581 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:13.581 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:13.581 fio-3.35 00:14:13.581 Starting 4 threads 00:14:14.961 00:14:14.961 job0: (groupid=0, jobs=1): err= 0: pid=3011218: Wed Apr 24 19:21:01 2024 00:14:14.961 read: IOPS=3660, BW=14.3MiB/s (15.0MB/s)(14.3MiB/1001msec) 00:14:14.961 slat (nsec): min=8398, max=27238, avg=9090.21, stdev=931.21 00:14:14.961 clat (usec): min=76, max=189, avg=120.35, stdev=14.82 00:14:14.961 lat (usec): min=84, max=198, avg=129.44, stdev=14.87 00:14:14.961 clat percentiles (usec): 00:14:14.961 | 1.00th=[ 82], 5.00th=[ 89], 10.00th=[ 97], 20.00th=[ 113], 00:14:14.961 | 30.00th=[ 117], 40.00th=[ 120], 50.00th=[ 123], 60.00th=[ 125], 00:14:14.961 | 70.00th=[ 128], 80.00th=[ 131], 90.00th=[ 137], 95.00th=[ 141], 00:14:14.961 | 99.00th=[ 155], 99.50th=[ 163], 99.90th=[ 176], 99.95th=[ 180], 00:14:14.961 | 99.99th=[ 190] 00:14:14.961 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:14:14.961 slat (nsec): min=8808, max=48765, avg=10977.43, stdev=1215.77 00:14:14.961 clat (usec): min=58, max=183, avg=113.56, stdev=13.32 00:14:14.961 lat (usec): min=77, max=194, avg=124.54, stdev=13.37 00:14:14.961 clat percentiles (usec): 00:14:14.961 | 1.00th=[ 78], 5.00th=[ 87], 10.00th=[ 98], 20.00th=[ 105], 00:14:14.961 | 30.00th=[ 110], 40.00th=[ 113], 50.00th=[ 115], 60.00th=[ 117], 00:14:14.961 | 70.00th=[ 120], 80.00th=[ 123], 90.00th=[ 128], 95.00th=[ 133], 00:14:14.961 | 99.00th=[ 151], 99.50th=[ 159], 99.90th=[ 174], 99.95th=[ 176], 00:14:14.961 | 99.99th=[ 184] 00:14:14.961 bw ( KiB/s): min=16351, max=16351, per=22.25%, avg=16351.00, stdev= 0.00, samples=1 00:14:14.961 iops : min= 4087, max= 4087, avg=4087.00, stdev= 0.00, samples=1 00:14:14.961 lat (usec) : 100=11.30%, 250=88.70% 00:14:14.961 cpu : usr=4.30%, sys=8.40%, ctx=7760, majf=0, minf=1 00:14:14.961 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:14.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 issued rwts: total=3664,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:14.962 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:14.962 job1: (groupid=0, jobs=1): err= 0: pid=3011219: Wed Apr 24 19:21:01 2024 00:14:14.962 read: IOPS=4209, BW=16.4MiB/s (17.2MB/s)(16.5MiB/1001msec) 00:14:14.962 slat (nsec): min=8060, max=40120, avg=8917.95, stdev=1176.79 00:14:14.962 clat (usec): min=68, max=188, avg=106.26, stdev=22.16 00:14:14.962 lat (usec): min=77, max=196, avg=115.17, stdev=22.14 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 76], 5.00th=[ 80], 10.00th=[ 82], 20.00th=[ 85], 00:14:14.962 | 30.00th=[ 88], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 117], 00:14:14.962 | 70.00th=[ 124], 80.00th=[ 129], 90.00th=[ 135], 95.00th=[ 141], 00:14:14.962 | 99.00th=[ 155], 99.50th=[ 165], 99.90th=[ 180], 99.95th=[ 184], 00:14:14.962 | 99.99th=[ 190] 00:14:14.962 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:14:14.962 slat (nsec): min=8736, max=49308, avg=11041.32, stdev=1634.61 00:14:14.962 clat (usec): min=62, max=548, avg=96.63, stdev=21.34 00:14:14.962 lat (usec): min=72, max=559, avg=107.67, stdev=21.36 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 70], 5.00th=[ 74], 10.00th=[ 76], 20.00th=[ 79], 00:14:14.962 | 30.00th=[ 81], 40.00th=[ 84], 50.00th=[ 88], 60.00th=[ 103], 00:14:14.962 | 70.00th=[ 113], 80.00th=[ 119], 90.00th=[ 124], 95.00th=[ 130], 00:14:14.962 | 99.00th=[ 143], 99.50th=[ 153], 99.90th=[ 178], 99.95th=[ 180], 00:14:14.962 | 99.99th=[ 545] 00:14:14.962 bw ( KiB/s): min=16351, max=16351, per=22.25%, avg=16351.00, stdev= 0.00, samples=1 00:14:14.962 iops : min= 4087, max= 4087, avg=4087.00, stdev= 0.00, samples=1 00:14:14.962 lat (usec) : 100=53.73%, 250=46.26%, 750=0.01% 00:14:14.962 cpu : usr=5.30%, sys=9.20%, ctx=8823, majf=0, minf=1 00:14:14.962 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:14.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 issued rwts: total=4214,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:14.962 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:14.962 job2: (groupid=0, jobs=1): err= 0: pid=3011220: Wed Apr 24 19:21:01 2024 00:14:14.962 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:14:14.962 slat (nsec): min=8405, max=27249, avg=9020.77, stdev=1076.62 00:14:14.962 clat (usec): min=73, max=124, avg=93.37, stdev= 6.80 00:14:14.962 lat (usec): min=82, max=132, avg=102.39, stdev= 6.87 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 81], 5.00th=[ 84], 10.00th=[ 86], 20.00th=[ 88], 00:14:14.962 | 30.00th=[ 90], 40.00th=[ 92], 50.00th=[ 93], 60.00th=[ 95], 00:14:14.962 | 70.00th=[ 96], 80.00th=[ 99], 90.00th=[ 102], 95.00th=[ 106], 00:14:14.962 | 99.00th=[ 114], 99.50th=[ 116], 99.90th=[ 120], 99.95th=[ 122], 00:14:14.962 | 99.99th=[ 125] 00:14:14.962 write: IOPS=5074, BW=19.8MiB/s (20.8MB/s)(19.8MiB/1001msec); 0 zone resets 00:14:14.962 slat (nsec): min=10385, max=43022, avg=11085.67, stdev=1402.38 00:14:14.962 clat (usec): min=66, max=178, avg=89.11, stdev= 9.40 00:14:14.962 lat (usec): min=79, max=219, avg=100.19, stdev= 9.56 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 76], 5.00th=[ 79], 10.00th=[ 81], 20.00th=[ 83], 00:14:14.962 | 30.00th=[ 85], 40.00th=[ 87], 50.00th=[ 88], 60.00th=[ 90], 00:14:14.962 | 70.00th=[ 92], 80.00th=[ 94], 90.00th=[ 98], 95.00th=[ 103], 00:14:14.962 | 99.00th=[ 129], 99.50th=[ 135], 99.90th=[ 159], 99.95th=[ 161], 00:14:14.962 | 99.99th=[ 180] 00:14:14.962 bw ( KiB/s): min=20480, max=20480, per=27.87%, avg=20480.00, stdev= 0.00, samples=1 00:14:14.962 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:14:14.962 lat (usec) : 100=88.70%, 250=11.30% 00:14:14.962 cpu : usr=5.40%, sys=10.50%, ctx=9688, majf=0, minf=1 00:14:14.962 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:14.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 issued rwts: total=4608,5080,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:14.962 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:14.962 job3: (groupid=0, jobs=1): err= 0: pid=3011221: Wed Apr 24 19:21:01 2024 00:14:14.962 read: IOPS=4219, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1001msec) 00:14:14.962 slat (nsec): min=8426, max=35671, avg=9150.48, stdev=1500.43 00:14:14.962 clat (usec): min=78, max=201, avg=102.72, stdev=14.30 00:14:14.962 lat (usec): min=86, max=211, avg=111.88, stdev=14.56 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 83], 5.00th=[ 86], 10.00th=[ 88], 20.00th=[ 91], 00:14:14.962 | 30.00th=[ 93], 40.00th=[ 96], 50.00th=[ 99], 60.00th=[ 103], 00:14:14.962 | 70.00th=[ 111], 80.00th=[ 118], 90.00th=[ 125], 95.00th=[ 129], 00:14:14.962 | 99.00th=[ 137], 99.50th=[ 141], 99.90th=[ 155], 99.95th=[ 165], 00:14:14.962 | 99.99th=[ 202] 00:14:14.962 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:14:14.962 slat (nsec): min=10355, max=49845, avg=11195.05, stdev=1730.41 00:14:14.962 clat (usec): min=72, max=330, avg=99.31, stdev=15.66 00:14:14.962 lat (usec): min=83, max=341, avg=110.51, stdev=15.86 00:14:14.962 clat percentiles (usec): 00:14:14.962 | 1.00th=[ 78], 5.00th=[ 81], 10.00th=[ 83], 20.00th=[ 86], 00:14:14.962 | 30.00th=[ 89], 40.00th=[ 92], 50.00th=[ 95], 60.00th=[ 101], 00:14:14.962 | 70.00th=[ 109], 80.00th=[ 114], 90.00th=[ 120], 95.00th=[ 127], 00:14:14.962 | 99.00th=[ 145], 99.50th=[ 147], 99.90th=[ 169], 99.95th=[ 196], 00:14:14.962 | 99.99th=[ 330] 00:14:14.962 bw ( KiB/s): min=20439, max=20439, per=27.81%, avg=20439.00, stdev= 0.00, samples=1 00:14:14.962 iops : min= 5109, max= 5109, avg=5109.00, stdev= 0.00, samples=1 00:14:14.962 lat (usec) : 100=56.91%, 250=43.08%, 500=0.01% 00:14:14.962 cpu : usr=4.90%, sys=9.80%, ctx=8832, majf=0, minf=1 00:14:14.962 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:14.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:14.962 issued rwts: total=4224,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:14.962 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:14.962 00:14:14.962 Run status group 0 (all jobs): 00:14:14.962 READ: bw=65.2MiB/s (68.4MB/s), 14.3MiB/s-18.0MiB/s (15.0MB/s-18.9MB/s), io=65.3MiB (68.4MB), run=1001-1001msec 00:14:14.962 WRITE: bw=71.8MiB/s (75.3MB/s), 16.0MiB/s-19.8MiB/s (16.8MB/s-20.8MB/s), io=71.8MiB (75.3MB), run=1001-1001msec 00:14:14.962 00:14:14.962 Disk stats (read/write): 00:14:14.962 nvme0n1: ios=3122/3516, merge=0/0, ticks=346/377, in_queue=723, util=85.57% 00:14:14.962 nvme0n2: ios=3584/3622, merge=0/0, ticks=379/338, in_queue=717, util=86.27% 00:14:14.962 nvme0n3: ios=4096/4107, merge=0/0, ticks=363/353, in_queue=716, util=88.80% 00:14:14.962 nvme0n4: ios=3584/4079, merge=0/0, ticks=339/375, in_queue=714, util=89.65% 00:14:14.962 19:21:01 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:14:14.963 [global] 00:14:14.963 thread=1 00:14:14.963 invalidate=1 00:14:14.963 rw=write 00:14:14.963 time_based=1 00:14:14.963 runtime=1 00:14:14.963 ioengine=libaio 00:14:14.963 direct=1 00:14:14.963 bs=4096 00:14:14.963 iodepth=128 00:14:14.963 norandommap=0 00:14:14.963 numjobs=1 00:14:14.963 00:14:14.963 verify_dump=1 00:14:14.963 verify_backlog=512 00:14:14.963 verify_state_save=0 00:14:14.963 do_verify=1 00:14:14.963 verify=crc32c-intel 00:14:14.963 [job0] 00:14:14.963 filename=/dev/nvme0n1 00:14:14.963 [job1] 00:14:14.963 filename=/dev/nvme0n2 00:14:14.963 [job2] 00:14:14.963 filename=/dev/nvme0n3 00:14:14.963 [job3] 00:14:14.963 filename=/dev/nvme0n4 00:14:14.963 Could not set queue depth (nvme0n1) 00:14:14.963 Could not set queue depth (nvme0n2) 00:14:14.963 Could not set queue depth (nvme0n3) 00:14:14.963 Could not set queue depth (nvme0n4) 00:14:14.963 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:14.963 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:14.963 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:14.963 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:14.963 fio-3.35 00:14:14.963 Starting 4 threads 00:14:16.343 00:14:16.343 job0: (groupid=0, jobs=1): err= 0: pid=3011612: Wed Apr 24 19:21:03 2024 00:14:16.343 read: IOPS=5675, BW=22.2MiB/s (23.2MB/s)(22.2MiB/1001msec) 00:14:16.343 slat (usec): min=2, max=5903, avg=83.27, stdev=403.89 00:14:16.343 clat (usec): min=393, max=21196, avg=10936.31, stdev=3533.58 00:14:16.343 lat (usec): min=1104, max=22732, avg=11019.57, stdev=3549.56 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 3523], 5.00th=[ 5669], 10.00th=[ 6587], 20.00th=[ 7963], 00:14:16.343 | 30.00th=[ 8848], 40.00th=[ 9634], 50.00th=[10552], 60.00th=[11600], 00:14:16.343 | 70.00th=[12518], 80.00th=[14091], 90.00th=[15533], 95.00th=[17433], 00:14:16.343 | 99.00th=[19268], 99.50th=[20841], 99.90th=[21103], 99.95th=[21103], 00:14:16.343 | 99.99th=[21103] 00:14:16.343 write: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1001msec); 0 zone resets 00:14:16.343 slat (usec): min=2, max=5867, avg=80.82, stdev=371.54 00:14:16.343 clat (usec): min=3246, max=20732, avg=10510.48, stdev=3412.47 00:14:16.343 lat (usec): min=3263, max=22461, avg=10591.29, stdev=3430.83 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4293], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 7308], 00:14:16.343 | 30.00th=[ 8455], 40.00th=[ 9503], 50.00th=[10421], 60.00th=[11338], 00:14:16.343 | 70.00th=[12518], 80.00th=[13698], 90.00th=[14877], 95.00th=[16188], 00:14:16.343 | 99.00th=[18744], 99.50th=[19530], 99.90th=[20841], 99.95th=[20841], 00:14:16.343 | 99.99th=[20841] 00:14:16.343 bw ( KiB/s): min=24576, max=24576, per=25.09%, avg=24576.00, stdev= 0.00, samples=1 00:14:16.343 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=1 00:14:16.343 lat (usec) : 500=0.01% 00:14:16.343 lat (msec) : 2=0.14%, 4=0.68%, 10=42.41%, 20=56.21%, 50=0.54% 00:14:16.343 cpu : usr=3.60%, sys=6.70%, ctx=1296, majf=0, minf=1 00:14:16.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:16.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:16.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:16.343 issued rwts: total=5681,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:16.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:16.343 job1: (groupid=0, jobs=1): err= 0: pid=3011613: Wed Apr 24 19:21:03 2024 00:14:16.343 read: IOPS=5657, BW=22.1MiB/s (23.2MB/s)(22.1MiB/1002msec) 00:14:16.343 slat (usec): min=2, max=5765, avg=88.23, stdev=436.16 00:14:16.343 clat (usec): min=1615, max=20942, avg=10980.21, stdev=3913.44 00:14:16.343 lat (usec): min=2398, max=22677, avg=11068.44, stdev=3935.21 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4146], 5.00th=[ 5669], 10.00th=[ 6521], 20.00th=[ 7373], 00:14:16.343 | 30.00th=[ 8225], 40.00th=[ 8979], 50.00th=[10290], 60.00th=[11994], 00:14:16.343 | 70.00th=[13304], 80.00th=[14484], 90.00th=[16712], 95.00th=[17957], 00:14:16.343 | 99.00th=[20317], 99.50th=[20317], 99.90th=[20841], 99.95th=[20841], 00:14:16.343 | 99.99th=[20841] 00:14:16.343 write: IOPS=6131, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1002msec); 0 zone resets 00:14:16.343 slat (usec): min=2, max=5391, avg=76.72, stdev=358.71 00:14:16.343 clat (usec): min=3271, max=21115, avg=10502.79, stdev=3698.61 00:14:16.343 lat (usec): min=3275, max=21124, avg=10579.50, stdev=3718.02 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4178], 5.00th=[ 5407], 10.00th=[ 6194], 20.00th=[ 7046], 00:14:16.343 | 30.00th=[ 8094], 40.00th=[ 9110], 50.00th=[ 9896], 60.00th=[10945], 00:14:16.343 | 70.00th=[12125], 80.00th=[13829], 90.00th=[15926], 95.00th=[17433], 00:14:16.343 | 99.00th=[19006], 99.50th=[19530], 99.90th=[20841], 99.95th=[20841], 00:14:16.343 | 99.99th=[21103] 00:14:16.343 bw ( KiB/s): min=19760, max=28672, per=24.72%, avg=24216.00, stdev=6301.74, samples=2 00:14:16.343 iops : min= 4940, max= 7168, avg=6054.00, stdev=1575.43, samples=2 00:14:16.343 lat (msec) : 2=0.01%, 4=0.47%, 10=48.35%, 20=50.25%, 50=0.91% 00:14:16.343 cpu : usr=3.10%, sys=6.59%, ctx=1432, majf=0, minf=1 00:14:16.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:16.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:16.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:16.343 issued rwts: total=5669,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:16.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:16.343 job2: (groupid=0, jobs=1): err= 0: pid=3011617: Wed Apr 24 19:21:03 2024 00:14:16.343 read: IOPS=5948, BW=23.2MiB/s (24.4MB/s)(23.3MiB/1002msec) 00:14:16.343 slat (usec): min=2, max=4840, avg=81.01, stdev=365.32 00:14:16.343 clat (usec): min=1652, max=21084, avg=10482.29, stdev=3330.66 00:14:16.343 lat (usec): min=2521, max=21087, avg=10563.30, stdev=3346.37 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4686], 5.00th=[ 5866], 10.00th=[ 6390], 20.00th=[ 7177], 00:14:16.343 | 30.00th=[ 8160], 40.00th=[ 9241], 50.00th=[10159], 60.00th=[11207], 00:14:16.343 | 70.00th=[12518], 80.00th=[13435], 90.00th=[15139], 95.00th=[15926], 00:14:16.343 | 99.00th=[18482], 99.50th=[18744], 99.90th=[19530], 99.95th=[21103], 00:14:16.343 | 99.99th=[21103] 00:14:16.343 write: IOPS=6131, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1002msec); 0 zone resets 00:14:16.343 slat (usec): min=2, max=5724, avg=78.87, stdev=364.42 00:14:16.343 clat (usec): min=3377, max=21648, avg=10489.02, stdev=3366.79 00:14:16.343 lat (usec): min=3388, max=21653, avg=10567.88, stdev=3380.19 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 5407], 5.00th=[ 6259], 10.00th=[ 6521], 20.00th=[ 7242], 00:14:16.343 | 30.00th=[ 7963], 40.00th=[ 8717], 50.00th=[10028], 60.00th=[11338], 00:14:16.343 | 70.00th=[12518], 80.00th=[13566], 90.00th=[15008], 95.00th=[16581], 00:14:16.343 | 99.00th=[18220], 99.50th=[19006], 99.90th=[20317], 99.95th=[21627], 00:14:16.343 | 99.99th=[21627] 00:14:16.343 bw ( KiB/s): min=21056, max=28096, per=25.09%, avg=24576.00, stdev=4978.03, samples=2 00:14:16.343 iops : min= 5264, max= 7024, avg=6144.00, stdev=1244.51, samples=2 00:14:16.343 lat (msec) : 2=0.01%, 4=0.21%, 10=48.58%, 20=51.06%, 50=0.14% 00:14:16.343 cpu : usr=3.40%, sys=7.59%, ctx=1261, majf=0, minf=1 00:14:16.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:16.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:16.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:16.343 issued rwts: total=5960,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:16.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:16.343 job3: (groupid=0, jobs=1): err= 0: pid=3011623: Wed Apr 24 19:21:03 2024 00:14:16.343 read: IOPS=5626, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1001msec) 00:14:16.343 slat (usec): min=2, max=7212, avg=85.83, stdev=411.73 00:14:16.343 clat (usec): min=3839, max=22170, avg=11303.54, stdev=3541.96 00:14:16.343 lat (usec): min=3843, max=22187, avg=11389.38, stdev=3560.48 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4883], 5.00th=[ 6456], 10.00th=[ 7111], 20.00th=[ 7767], 00:14:16.343 | 30.00th=[ 8717], 40.00th=[10028], 50.00th=[11076], 60.00th=[11994], 00:14:16.343 | 70.00th=[12911], 80.00th=[14353], 90.00th=[16581], 95.00th=[17957], 00:14:16.343 | 99.00th=[19006], 99.50th=[19268], 99.90th=[19792], 99.95th=[21103], 00:14:16.343 | 99.99th=[22152] 00:14:16.343 write: IOPS=6100, BW=23.8MiB/s (25.0MB/s)(23.9MiB/1001msec); 0 zone resets 00:14:16.343 slat (usec): min=2, max=7315, avg=79.75, stdev=357.34 00:14:16.343 clat (usec): min=601, max=22884, avg=10292.40, stdev=3477.56 00:14:16.343 lat (usec): min=1304, max=22896, avg=10372.14, stdev=3494.85 00:14:16.343 clat percentiles (usec): 00:14:16.343 | 1.00th=[ 4080], 5.00th=[ 6325], 10.00th=[ 6783], 20.00th=[ 7504], 00:14:16.343 | 30.00th=[ 7963], 40.00th=[ 8586], 50.00th=[ 9372], 60.00th=[10421], 00:14:16.343 | 70.00th=[11469], 80.00th=[13042], 90.00th=[15533], 95.00th=[17433], 00:14:16.343 | 99.00th=[19268], 99.50th=[21365], 99.90th=[22676], 99.95th=[22938], 00:14:16.343 | 99.99th=[22938] 00:14:16.343 bw ( KiB/s): min=24632, max=24632, per=25.14%, avg=24632.00, stdev= 0.00, samples=1 00:14:16.343 iops : min= 6158, max= 6158, avg=6158.00, stdev= 0.00, samples=1 00:14:16.343 lat (usec) : 750=0.01% 00:14:16.343 lat (msec) : 2=0.21%, 4=0.36%, 10=47.34%, 20=51.57%, 50=0.51% 00:14:16.343 cpu : usr=3.20%, sys=6.80%, ctx=1196, majf=0, minf=1 00:14:16.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:16.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:16.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:16.343 issued rwts: total=5632,6107,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:16.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:16.343 00:14:16.343 Run status group 0 (all jobs): 00:14:16.343 READ: bw=89.4MiB/s (93.8MB/s), 22.0MiB/s-23.2MiB/s (23.0MB/s-24.4MB/s), io=89.6MiB (94.0MB), run=1001-1002msec 00:14:16.343 WRITE: bw=95.7MiB/s (100MB/s), 23.8MiB/s-24.0MiB/s (25.0MB/s-25.1MB/s), io=95.9MiB (101MB), run=1001-1002msec 00:14:16.343 00:14:16.343 Disk stats (read/write): 00:14:16.343 nvme0n1: ios=4658/5054, merge=0/0, ticks=15546/15867, in_queue=31413, util=82.36% 00:14:16.343 nvme0n2: ios=4947/5120, merge=0/0, ticks=15300/13864, in_queue=29164, util=84.54% 00:14:16.343 nvme0n3: ios=4608/4791, merge=0/0, ticks=15825/15938, in_queue=31763, util=87.01% 00:14:16.343 nvme0n4: ios=4808/5120, merge=0/0, ticks=16361/14948, in_queue=31309, util=87.90% 00:14:16.343 19:21:03 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:14:16.343 [global] 00:14:16.343 thread=1 00:14:16.343 invalidate=1 00:14:16.343 rw=randwrite 00:14:16.343 time_based=1 00:14:16.343 runtime=1 00:14:16.343 ioengine=libaio 00:14:16.343 direct=1 00:14:16.343 bs=4096 00:14:16.343 iodepth=128 00:14:16.343 norandommap=0 00:14:16.343 numjobs=1 00:14:16.343 00:14:16.343 verify_dump=1 00:14:16.343 verify_backlog=512 00:14:16.343 verify_state_save=0 00:14:16.343 do_verify=1 00:14:16.343 verify=crc32c-intel 00:14:16.343 [job0] 00:14:16.343 filename=/dev/nvme0n1 00:14:16.343 [job1] 00:14:16.343 filename=/dev/nvme0n2 00:14:16.344 [job2] 00:14:16.344 filename=/dev/nvme0n3 00:14:16.344 [job3] 00:14:16.344 filename=/dev/nvme0n4 00:14:16.344 Could not set queue depth (nvme0n1) 00:14:16.344 Could not set queue depth (nvme0n2) 00:14:16.344 Could not set queue depth (nvme0n3) 00:14:16.344 Could not set queue depth (nvme0n4) 00:14:16.602 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:16.602 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:16.602 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:16.602 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:16.602 fio-3.35 00:14:16.602 Starting 4 threads 00:14:17.983 00:14:17.983 job0: (groupid=0, jobs=1): err= 0: pid=3011920: Wed Apr 24 19:21:04 2024 00:14:17.983 read: IOPS=10.1k, BW=39.5MiB/s (41.4MB/s)(39.6MiB/1003msec) 00:14:17.983 slat (usec): min=2, max=953, avg=49.45, stdev=181.73 00:14:17.983 clat (usec): min=1617, max=7359, avg=6443.40, stdev=597.86 00:14:17.983 lat (usec): min=2221, max=8125, avg=6492.85, stdev=592.99 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 4948], 5.00th=[ 5473], 10.00th=[ 5538], 20.00th=[ 5932], 00:14:17.983 | 30.00th=[ 6259], 40.00th=[ 6456], 50.00th=[ 6652], 60.00th=[ 6718], 00:14:17.983 | 70.00th=[ 6849], 80.00th=[ 6915], 90.00th=[ 6980], 95.00th=[ 7111], 00:14:17.983 | 99.00th=[ 7242], 99.50th=[ 7242], 99.90th=[ 7373], 99.95th=[ 7373], 00:14:17.983 | 99.99th=[ 7373] 00:14:17.983 write: IOPS=10.2k, BW=39.9MiB/s (41.8MB/s)(40.0MiB/1003msec); 0 zone resets 00:14:17.983 slat (usec): min=2, max=2112, avg=46.25, stdev=168.62 00:14:17.983 clat (usec): min=3509, max=9288, avg=6009.94, stdev=644.37 00:14:17.983 lat (usec): min=3542, max=9300, avg=6056.19, stdev=641.61 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 4555], 5.00th=[ 5014], 10.00th=[ 5080], 20.00th=[ 5276], 00:14:17.983 | 30.00th=[ 5669], 40.00th=[ 5932], 50.00th=[ 6259], 60.00th=[ 6325], 00:14:17.983 | 70.00th=[ 6390], 80.00th=[ 6521], 90.00th=[ 6652], 95.00th=[ 6718], 00:14:17.983 | 99.00th=[ 7308], 99.50th=[ 7635], 99.90th=[ 9241], 99.95th=[ 9241], 00:14:17.983 | 99.99th=[ 9241] 00:14:17.983 bw ( KiB/s): min=39336, max=42584, per=40.16%, avg=40960.00, stdev=2296.68, samples=2 00:14:17.983 iops : min= 9834, max=10646, avg=10240.00, stdev=574.17, samples=2 00:14:17.983 lat (msec) : 2=0.01%, 4=0.27%, 10=99.73% 00:14:17.983 cpu : usr=3.29%, sys=6.09%, ctx=1304, majf=0, minf=1 00:14:17.983 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:14:17.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:17.983 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:17.983 issued rwts: total=10132,10240,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:17.983 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:17.983 job1: (groupid=0, jobs=1): err= 0: pid=3011923: Wed Apr 24 19:21:04 2024 00:14:17.983 read: IOPS=3482, BW=13.6MiB/s (14.3MB/s)(13.7MiB/1008msec) 00:14:17.983 slat (usec): min=2, max=10214, avg=133.20, stdev=756.97 00:14:17.983 clat (usec): min=3189, max=48336, avg=16990.79, stdev=8568.27 00:14:17.983 lat (usec): min=3655, max=48348, avg=17123.99, stdev=8626.89 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 4178], 5.00th=[ 5080], 10.00th=[ 7504], 20.00th=[ 9372], 00:14:17.983 | 30.00th=[12256], 40.00th=[14091], 50.00th=[15270], 60.00th=[16909], 00:14:17.983 | 70.00th=[19006], 80.00th=[23725], 90.00th=[30016], 95.00th=[33162], 00:14:17.983 | 99.00th=[39584], 99.50th=[41157], 99.90th=[41157], 99.95th=[43779], 00:14:17.983 | 99.99th=[48497] 00:14:17.983 write: IOPS=3555, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1008msec); 0 zone resets 00:14:17.983 slat (usec): min=2, max=9532, avg=144.57, stdev=769.25 00:14:17.983 clat (usec): min=3302, max=44235, avg=18885.99, stdev=11611.28 00:14:17.983 lat (usec): min=3308, max=44245, avg=19030.56, stdev=11672.70 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 4015], 5.00th=[ 4948], 10.00th=[ 5473], 20.00th=[ 7111], 00:14:17.983 | 30.00th=[10421], 40.00th=[13173], 50.00th=[15401], 60.00th=[20055], 00:14:17.983 | 70.00th=[23462], 80.00th=[30802], 90.00th=[38011], 95.00th=[39060], 00:14:17.983 | 99.00th=[40633], 99.50th=[40633], 99.90th=[42206], 99.95th=[44303], 00:14:17.983 | 99.99th=[44303] 00:14:17.983 bw ( KiB/s): min=14320, max=14352, per=14.06%, avg=14336.00, stdev=22.63, samples=2 00:14:17.983 iops : min= 3580, max= 3588, avg=3584.00, stdev= 5.66, samples=2 00:14:17.983 lat (msec) : 4=0.83%, 10=25.20%, 20=39.39%, 50=34.58% 00:14:17.983 cpu : usr=2.09%, sys=3.28%, ctx=744, majf=0, minf=1 00:14:17.983 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:14:17.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:17.983 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:17.983 issued rwts: total=3510,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:17.983 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:17.983 job2: (groupid=0, jobs=1): err= 0: pid=3011930: Wed Apr 24 19:21:04 2024 00:14:17.983 read: IOPS=6250, BW=24.4MiB/s (25.6MB/s)(24.6MiB/1007msec) 00:14:17.983 slat (usec): min=2, max=3668, avg=78.35, stdev=305.48 00:14:17.983 clat (usec): min=6643, max=16283, avg=10153.27, stdev=1142.44 00:14:17.983 lat (usec): min=7126, max=16286, avg=10231.62, stdev=1159.58 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 7832], 5.00th=[ 8356], 10.00th=[ 8586], 20.00th=[ 9241], 00:14:17.983 | 30.00th=[ 9634], 40.00th=[ 9896], 50.00th=[10028], 60.00th=[10290], 00:14:17.983 | 70.00th=[10683], 80.00th=[11076], 90.00th=[11600], 95.00th=[11994], 00:14:17.983 | 99.00th=[13173], 99.50th=[13960], 99.90th=[16319], 99.95th=[16319], 00:14:17.983 | 99.99th=[16319] 00:14:17.983 write: IOPS=6609, BW=25.8MiB/s (27.1MB/s)(26.0MiB/1007msec); 0 zone resets 00:14:17.983 slat (usec): min=2, max=3567, avg=73.26, stdev=289.59 00:14:17.983 clat (usec): min=1536, max=14217, avg=9550.25, stdev=1228.72 00:14:17.983 lat (usec): min=1547, max=14229, avg=9623.51, stdev=1248.26 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 4490], 5.00th=[ 7767], 10.00th=[ 8160], 20.00th=[ 8848], 00:14:17.983 | 30.00th=[ 9372], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[ 9765], 00:14:17.983 | 70.00th=[10028], 80.00th=[10421], 90.00th=[10814], 95.00th=[11338], 00:14:17.983 | 99.00th=[11994], 99.50th=[12387], 99.90th=[13435], 99.95th=[13435], 00:14:17.983 | 99.99th=[14222] 00:14:17.983 bw ( KiB/s): min=24576, max=28672, per=26.10%, avg=26624.00, stdev=2896.31, samples=2 00:14:17.983 iops : min= 6144, max= 7168, avg=6656.00, stdev=724.08, samples=2 00:14:17.983 lat (msec) : 2=0.02%, 4=0.30%, 10=57.20%, 20=42.48% 00:14:17.983 cpu : usr=2.49%, sys=4.77%, ctx=943, majf=0, minf=1 00:14:17.983 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:14:17.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:17.983 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:17.983 issued rwts: total=6294,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:17.983 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:17.983 job3: (groupid=0, jobs=1): err= 0: pid=3011931: Wed Apr 24 19:21:04 2024 00:14:17.983 read: IOPS=5084, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1007msec) 00:14:17.983 slat (usec): min=2, max=8857, avg=95.43, stdev=463.19 00:14:17.983 clat (usec): min=4314, max=42364, avg=12414.52, stdev=6380.56 00:14:17.983 lat (usec): min=4318, max=42372, avg=12509.95, stdev=6421.47 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 5473], 5.00th=[ 6783], 10.00th=[ 7504], 20.00th=[ 8094], 00:14:17.983 | 30.00th=[ 8455], 40.00th=[ 8979], 50.00th=[10290], 60.00th=[11731], 00:14:17.983 | 70.00th=[13698], 80.00th=[15664], 90.00th=[19530], 95.00th=[25822], 00:14:17.983 | 99.00th=[40109], 99.50th=[40633], 99.90th=[42206], 99.95th=[42206], 00:14:17.983 | 99.99th=[42206] 00:14:17.983 write: IOPS=5185, BW=20.3MiB/s (21.2MB/s)(20.4MiB/1007msec); 0 zone resets 00:14:17.983 slat (usec): min=2, max=9682, avg=93.05, stdev=515.57 00:14:17.983 clat (usec): min=4728, max=42050, avg=12253.41, stdev=6832.79 00:14:17.983 lat (usec): min=4737, max=46074, avg=12346.46, stdev=6883.40 00:14:17.983 clat percentiles (usec): 00:14:17.983 | 1.00th=[ 5276], 5.00th=[ 6783], 10.00th=[ 7177], 20.00th=[ 7504], 00:14:17.983 | 30.00th=[ 7832], 40.00th=[ 8029], 50.00th=[ 8586], 60.00th=[10028], 00:14:17.983 | 70.00th=[14222], 80.00th=[17171], 90.00th=[22676], 95.00th=[26608], 00:14:17.983 | 99.00th=[34866], 99.50th=[36439], 99.90th=[42206], 99.95th=[42206], 00:14:17.983 | 99.99th=[42206] 00:14:17.983 bw ( KiB/s): min=16416, max=24576, per=20.10%, avg=20496.00, stdev=5769.99, samples=2 00:14:17.983 iops : min= 4104, max= 6144, avg=5124.00, stdev=1442.50, samples=2 00:14:17.983 lat (msec) : 10=53.43%, 20=34.17%, 50=12.40% 00:14:17.983 cpu : usr=2.78%, sys=5.47%, ctx=930, majf=0, minf=1 00:14:17.983 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:14:17.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:17.983 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:17.983 issued rwts: total=5120,5222,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:17.983 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:17.983 00:14:17.983 Run status group 0 (all jobs): 00:14:17.983 READ: bw=97.1MiB/s (102MB/s), 13.6MiB/s-39.5MiB/s (14.3MB/s-41.4MB/s), io=97.9MiB (103MB), run=1003-1008msec 00:14:17.983 WRITE: bw=99.6MiB/s (104MB/s), 13.9MiB/s-39.9MiB/s (14.6MB/s-41.8MB/s), io=100MiB (105MB), run=1003-1008msec 00:14:17.983 00:14:17.983 Disk stats (read/write): 00:14:17.984 nvme0n1: ios=8242/8645, merge=0/0, ticks=26455/25980, in_queue=52435, util=85.37% 00:14:17.984 nvme0n2: ios=2901/3072, merge=0/0, ticks=14580/15731, in_queue=30311, util=84.52% 00:14:17.984 nvme0n3: ios=5300/5632, merge=0/0, ticks=52347/51519, in_queue=103866, util=88.68% 00:14:17.984 nvme0n4: ios=4608/4766, merge=0/0, ticks=15397/14505, in_queue=29902, util=88.35% 00:14:17.984 19:21:04 -- target/fio.sh@55 -- # sync 00:14:17.984 19:21:04 -- target/fio.sh@59 -- # fio_pid=3012249 00:14:17.984 19:21:04 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:14:17.984 19:21:04 -- target/fio.sh@61 -- # sleep 3 00:14:17.984 [global] 00:14:17.984 thread=1 00:14:17.984 invalidate=1 00:14:17.984 rw=read 00:14:17.984 time_based=1 00:14:17.984 runtime=10 00:14:17.984 ioengine=libaio 00:14:17.984 direct=1 00:14:17.984 bs=4096 00:14:17.984 iodepth=1 00:14:17.984 norandommap=1 00:14:17.984 numjobs=1 00:14:17.984 00:14:17.984 [job0] 00:14:17.984 filename=/dev/nvme0n1 00:14:17.984 [job1] 00:14:17.984 filename=/dev/nvme0n2 00:14:17.984 [job2] 00:14:17.984 filename=/dev/nvme0n3 00:14:17.984 [job3] 00:14:17.984 filename=/dev/nvme0n4 00:14:17.984 Could not set queue depth (nvme0n1) 00:14:17.984 Could not set queue depth (nvme0n2) 00:14:17.984 Could not set queue depth (nvme0n3) 00:14:17.984 Could not set queue depth (nvme0n4) 00:14:18.242 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:18.242 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:18.243 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:18.243 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:18.243 fio-3.35 00:14:18.243 Starting 4 threads 00:14:20.778 19:21:07 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:14:21.037 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=76836864, buflen=4096 00:14:21.037 fio: pid=3012545, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:21.037 19:21:07 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:14:21.296 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=88739840, buflen=4096 00:14:21.296 fio: pid=3012534, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:21.296 19:21:08 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:21.296 19:21:08 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:14:21.297 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=37343232, buflen=4096 00:14:21.297 fio: pid=3012502, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:21.556 19:21:08 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:21.556 19:21:08 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:14:21.556 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=59523072, buflen=4096 00:14:21.556 fio: pid=3012517, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:21.556 19:21:08 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:21.556 19:21:08 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:14:21.556 00:14:21.556 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3012502: Wed Apr 24 19:21:08 2024 00:14:21.556 read: IOPS=8274, BW=32.3MiB/s (33.9MB/s)(99.6MiB/3082msec) 00:14:21.556 slat (usec): min=3, max=18183, avg=11.27, stdev=164.25 00:14:21.556 clat (usec): min=48, max=484, avg=107.99, stdev=31.50 00:14:21.556 lat (usec): min=51, max=18302, avg=119.26, stdev=167.18 00:14:21.556 clat percentiles (usec): 00:14:21.556 | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 78], 20.00th=[ 82], 00:14:21.556 | 30.00th=[ 86], 40.00th=[ 89], 50.00th=[ 93], 60.00th=[ 105], 00:14:21.556 | 70.00th=[ 130], 80.00th=[ 139], 90.00th=[ 151], 95.00th=[ 165], 00:14:21.556 | 99.00th=[ 190], 99.50th=[ 198], 99.90th=[ 223], 99.95th=[ 231], 00:14:21.556 | 99.99th=[ 265] 00:14:21.556 bw ( KiB/s): min=27024, max=39840, per=26.79%, avg=31516.80, stdev=5136.19, samples=5 00:14:21.556 iops : min= 6756, max= 9960, avg=7879.20, stdev=1284.05, samples=5 00:14:21.556 lat (usec) : 50=0.01%, 100=58.13%, 250=41.84%, 500=0.02% 00:14:21.556 cpu : usr=2.66%, sys=9.61%, ctx=25507, majf=0, minf=1 00:14:21.556 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.556 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.556 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.556 issued rwts: total=25502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.556 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.556 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3012517: Wed Apr 24 19:21:08 2024 00:14:21.556 read: IOPS=9388, BW=36.7MiB/s (38.5MB/s)(121MiB/3293msec) 00:14:21.556 slat (usec): min=8, max=11898, avg=10.91, stdev=138.34 00:14:21.556 clat (usec): min=50, max=362, avg=94.22, stdev=29.56 00:14:21.556 lat (usec): min=59, max=12011, avg=105.13, stdev=141.56 00:14:21.556 clat percentiles (usec): 00:14:21.556 | 1.00th=[ 56], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 76], 00:14:21.556 | 30.00th=[ 79], 40.00th=[ 82], 50.00th=[ 85], 60.00th=[ 89], 00:14:21.556 | 70.00th=[ 94], 80.00th=[ 122], 90.00th=[ 145], 95.00th=[ 159], 00:14:21.556 | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 219], 99.95th=[ 231], 00:14:21.556 | 99.99th=[ 243] 00:14:21.556 bw ( KiB/s): min=30240, max=45008, per=31.29%, avg=36810.83, stdev=5851.25, samples=6 00:14:21.556 iops : min= 7560, max=11252, avg=9202.67, stdev=1462.82, samples=6 00:14:21.556 lat (usec) : 100=75.51%, 250=24.48%, 500=0.01% 00:14:21.556 cpu : usr=3.31%, sys=10.30%, ctx=30926, majf=0, minf=1 00:14:21.556 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.556 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.556 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.557 issued rwts: total=30917,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.557 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.557 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3012534: Wed Apr 24 19:21:08 2024 00:14:21.557 read: IOPS=7445, BW=29.1MiB/s (30.5MB/s)(84.6MiB/2910msec) 00:14:21.557 slat (usec): min=8, max=8884, avg=10.35, stdev=85.10 00:14:21.557 clat (usec): min=70, max=360, avg=121.55, stdev=26.72 00:14:21.557 lat (usec): min=81, max=8994, avg=131.90, stdev=89.22 00:14:21.557 clat percentiles (usec): 00:14:21.557 | 1.00th=[ 79], 5.00th=[ 86], 10.00th=[ 91], 20.00th=[ 96], 00:14:21.557 | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 122], 60.00th=[ 128], 00:14:21.557 | 70.00th=[ 135], 80.00th=[ 145], 90.00th=[ 157], 95.00th=[ 169], 00:14:21.557 | 99.00th=[ 196], 99.50th=[ 202], 99.90th=[ 221], 99.95th=[ 225], 00:14:21.557 | 99.99th=[ 243] 00:14:21.557 bw ( KiB/s): min=26112, max=36848, per=25.60%, avg=30112.00, stdev=4261.00, samples=5 00:14:21.557 iops : min= 6528, max= 9212, avg=7528.00, stdev=1065.25, samples=5 00:14:21.557 lat (usec) : 100=27.70%, 250=72.28%, 500=0.01% 00:14:21.557 cpu : usr=3.16%, sys=8.22%, ctx=21668, majf=0, minf=1 00:14:21.557 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.557 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.557 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.557 issued rwts: total=21666,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.557 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.557 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3012545: Wed Apr 24 19:21:08 2024 00:14:21.557 read: IOPS=6966, BW=27.2MiB/s (28.5MB/s)(73.3MiB/2693msec) 00:14:21.557 slat (nsec): min=8206, max=64028, avg=9418.59, stdev=1407.79 00:14:21.557 clat (usec): min=70, max=254, avg=132.46, stdev=22.79 00:14:21.557 lat (usec): min=79, max=305, avg=141.88, stdev=23.09 00:14:21.557 clat percentiles (usec): 00:14:21.557 | 1.00th=[ 80], 5.00th=[ 86], 10.00th=[ 96], 20.00th=[ 120], 00:14:21.557 | 30.00th=[ 126], 40.00th=[ 130], 50.00th=[ 135], 60.00th=[ 139], 00:14:21.557 | 70.00th=[ 143], 80.00th=[ 149], 90.00th=[ 157], 95.00th=[ 169], 00:14:21.557 | 99.00th=[ 190], 99.50th=[ 198], 99.90th=[ 217], 99.95th=[ 223], 00:14:21.557 | 99.99th=[ 249] 00:14:21.557 bw ( KiB/s): min=26056, max=30848, per=23.98%, avg=28206.40, stdev=1829.67, samples=5 00:14:21.557 iops : min= 6514, max= 7712, avg=7051.60, stdev=457.42, samples=5 00:14:21.557 lat (usec) : 100=10.96%, 250=89.02%, 500=0.01% 00:14:21.557 cpu : usr=2.08%, sys=8.43%, ctx=18761, majf=0, minf=2 00:14:21.557 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.557 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.557 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.557 issued rwts: total=18760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.557 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.557 00:14:21.557 Run status group 0 (all jobs): 00:14:21.557 READ: bw=115MiB/s (120MB/s), 27.2MiB/s-36.7MiB/s (28.5MB/s-38.5MB/s), io=378MiB (397MB), run=2693-3293msec 00:14:21.557 00:14:21.557 Disk stats (read/write): 00:14:21.557 nvme0n1: ios=23216/0, merge=0/0, ticks=2484/0, in_queue=2484, util=94.52% 00:14:21.557 nvme0n2: ios=28451/0, merge=0/0, ticks=2557/0, in_queue=2557, util=94.65% 00:14:21.557 nvme0n3: ios=21303/0, merge=0/0, ticks=2505/0, in_queue=2505, util=95.94% 00:14:21.557 nvme0n4: ios=18231/0, merge=0/0, ticks=2267/0, in_queue=2267, util=96.47% 00:14:21.816 19:21:08 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:21.816 19:21:08 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:14:22.074 19:21:08 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:22.074 19:21:08 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:14:22.333 19:21:09 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:22.333 19:21:09 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:14:22.592 19:21:09 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:22.592 19:21:09 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:14:22.592 19:21:09 -- target/fio.sh@69 -- # fio_status=0 00:14:22.592 19:21:09 -- target/fio.sh@70 -- # wait 3012249 00:14:22.592 19:21:09 -- target/fio.sh@70 -- # fio_status=4 00:14:22.592 19:21:09 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:23.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:23.529 19:21:10 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:23.529 19:21:10 -- common/autotest_common.sh@1205 -- # local i=0 00:14:23.529 19:21:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:23.529 19:21:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:23.529 19:21:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:23.529 19:21:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:23.529 19:21:10 -- common/autotest_common.sh@1217 -- # return 0 00:14:23.529 19:21:10 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:14:23.529 19:21:10 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:14:23.529 nvmf hotplug test: fio failed as expected 00:14:23.529 19:21:10 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.788 19:21:10 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:14:23.788 19:21:10 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:14:23.788 19:21:10 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:14:23.788 19:21:10 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:14:23.788 19:21:10 -- target/fio.sh@91 -- # nvmftestfini 00:14:23.788 19:21:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:23.788 19:21:10 -- nvmf/common.sh@117 -- # sync 00:14:23.788 19:21:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:23.788 19:21:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:23.788 19:21:10 -- nvmf/common.sh@120 -- # set +e 00:14:23.788 19:21:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:23.788 19:21:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:23.788 rmmod nvme_rdma 00:14:23.788 rmmod nvme_fabrics 00:14:23.788 19:21:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:23.788 19:21:10 -- nvmf/common.sh@124 -- # set -e 00:14:23.788 19:21:10 -- nvmf/common.sh@125 -- # return 0 00:14:23.788 19:21:10 -- nvmf/common.sh@478 -- # '[' -n 3009631 ']' 00:14:23.788 19:21:10 -- nvmf/common.sh@479 -- # killprocess 3009631 00:14:23.788 19:21:10 -- common/autotest_common.sh@936 -- # '[' -z 3009631 ']' 00:14:23.788 19:21:10 -- common/autotest_common.sh@940 -- # kill -0 3009631 00:14:23.788 19:21:10 -- common/autotest_common.sh@941 -- # uname 00:14:23.788 19:21:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:23.789 19:21:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3009631 00:14:24.048 19:21:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:24.048 19:21:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:24.048 19:21:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3009631' 00:14:24.048 killing process with pid 3009631 00:14:24.048 19:21:10 -- common/autotest_common.sh@955 -- # kill 3009631 00:14:24.048 19:21:10 -- common/autotest_common.sh@960 -- # wait 3009631 00:14:24.048 [2024-04-24 19:21:10.913253] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:24.307 19:21:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:24.307 19:21:11 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:24.307 00:14:24.307 real 0m25.396s 00:14:24.307 user 1m36.594s 00:14:24.307 sys 0m9.725s 00:14:24.307 19:21:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:24.307 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:14:24.307 ************************************ 00:14:24.307 END TEST nvmf_fio_target 00:14:24.307 ************************************ 00:14:24.307 19:21:11 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:14:24.307 19:21:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:24.307 19:21:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:24.307 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:14:24.567 ************************************ 00:14:24.567 START TEST nvmf_bdevio 00:14:24.567 ************************************ 00:14:24.567 19:21:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:14:24.567 * Looking for test storage... 00:14:24.567 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:24.567 19:21:11 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:24.567 19:21:11 -- nvmf/common.sh@7 -- # uname -s 00:14:24.567 19:21:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:24.567 19:21:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:24.567 19:21:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:24.567 19:21:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:24.567 19:21:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:24.567 19:21:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:24.567 19:21:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:24.567 19:21:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:24.567 19:21:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:24.567 19:21:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:24.567 19:21:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:14:24.567 19:21:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:14:24.567 19:21:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:24.567 19:21:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:24.567 19:21:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:24.567 19:21:11 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:24.567 19:21:11 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:24.567 19:21:11 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:24.567 19:21:11 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:24.567 19:21:11 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:24.567 19:21:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.567 19:21:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.567 19:21:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.567 19:21:11 -- paths/export.sh@5 -- # export PATH 00:14:24.567 19:21:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.567 19:21:11 -- nvmf/common.sh@47 -- # : 0 00:14:24.567 19:21:11 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:24.567 19:21:11 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:24.567 19:21:11 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:24.567 19:21:11 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:24.567 19:21:11 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:24.567 19:21:11 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:24.567 19:21:11 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:24.567 19:21:11 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:24.567 19:21:11 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:24.567 19:21:11 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:24.567 19:21:11 -- target/bdevio.sh@14 -- # nvmftestinit 00:14:24.567 19:21:11 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:24.567 19:21:11 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:24.567 19:21:11 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:24.567 19:21:11 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:24.567 19:21:11 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:24.567 19:21:11 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.567 19:21:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.567 19:21:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.567 19:21:11 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:24.567 19:21:11 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:24.567 19:21:11 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:24.567 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:14:31.140 19:21:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:31.140 19:21:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:31.140 19:21:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:31.140 19:21:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:31.140 19:21:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:31.140 19:21:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:31.140 19:21:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:31.140 19:21:16 -- nvmf/common.sh@295 -- # net_devs=() 00:14:31.140 19:21:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:31.140 19:21:16 -- nvmf/common.sh@296 -- # e810=() 00:14:31.140 19:21:16 -- nvmf/common.sh@296 -- # local -ga e810 00:14:31.140 19:21:16 -- nvmf/common.sh@297 -- # x722=() 00:14:31.140 19:21:16 -- nvmf/common.sh@297 -- # local -ga x722 00:14:31.140 19:21:16 -- nvmf/common.sh@298 -- # mlx=() 00:14:31.140 19:21:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:31.140 19:21:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:31.140 19:21:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:31.140 19:21:16 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:31.140 19:21:16 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:31.140 19:21:16 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:31.140 19:21:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:31.140 19:21:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:31.140 19:21:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:31.140 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:31.140 19:21:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:31.140 19:21:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:31.140 19:21:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:31.141 19:21:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:31.141 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:31.141 19:21:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:31.141 19:21:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:31.141 19:21:16 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:31.141 19:21:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:31.141 19:21:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:31.141 19:21:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:31.141 19:21:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:31.141 Found net devices under 0000:18:00.0: mlx_0_0 00:14:31.141 19:21:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:31.141 19:21:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:31.141 19:21:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:31.141 19:21:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:31.141 19:21:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:31.141 19:21:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:31.141 Found net devices under 0000:18:00.1: mlx_0_1 00:14:31.141 19:21:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:31.141 19:21:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:31.141 19:21:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:31.141 19:21:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:31.141 19:21:16 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:31.141 19:21:16 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:31.141 19:21:16 -- nvmf/common.sh@58 -- # uname 00:14:31.141 19:21:16 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:31.141 19:21:16 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:31.141 19:21:16 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:31.141 19:21:16 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:31.141 19:21:16 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:31.141 19:21:16 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:31.141 19:21:16 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:31.141 19:21:16 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:31.141 19:21:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:31.141 19:21:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:31.141 19:21:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:31.141 19:21:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:31.141 19:21:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:31.141 19:21:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:31.141 19:21:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:31.141 19:21:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:31.141 19:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:31.141 19:21:17 -- nvmf/common.sh@105 -- # continue 2 00:14:31.141 19:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:31.141 19:21:17 -- nvmf/common.sh@105 -- # continue 2 00:14:31.141 19:21:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:31.141 19:21:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:31.141 19:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:31.141 19:21:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:31.141 19:21:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:31.141 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:31.141 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:14:31.141 altname enp24s0f0np0 00:14:31.141 altname ens785f0np0 00:14:31.141 inet 192.168.100.8/24 scope global mlx_0_0 00:14:31.141 valid_lft forever preferred_lft forever 00:14:31.141 19:21:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:31.141 19:21:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:31.141 19:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:31.141 19:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:31.141 19:21:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:31.141 19:21:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:31.141 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:31.141 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:14:31.141 altname enp24s0f1np1 00:14:31.141 altname ens785f1np1 00:14:31.141 inet 192.168.100.9/24 scope global mlx_0_1 00:14:31.141 valid_lft forever preferred_lft forever 00:14:31.141 19:21:17 -- nvmf/common.sh@411 -- # return 0 00:14:31.141 19:21:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:31.141 19:21:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:31.141 19:21:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:31.141 19:21:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:31.141 19:21:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:31.141 19:21:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:31.141 19:21:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:31.141 19:21:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:31.141 19:21:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:31.141 19:21:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:31.141 19:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:31.141 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.142 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:31.142 19:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:31.142 19:21:17 -- nvmf/common.sh@105 -- # continue 2 00:14:31.142 19:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:31.142 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.142 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:31.142 19:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:31.142 19:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:31.142 19:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:31.142 19:21:17 -- nvmf/common.sh@105 -- # continue 2 00:14:31.142 19:21:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:31.142 19:21:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:31.142 19:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:31.142 19:21:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:31.142 19:21:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:31.142 19:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:31.142 19:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:31.142 19:21:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:31.142 192.168.100.9' 00:14:31.142 19:21:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:31.142 192.168.100.9' 00:14:31.142 19:21:17 -- nvmf/common.sh@446 -- # head -n 1 00:14:31.142 19:21:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:31.142 19:21:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:31.142 192.168.100.9' 00:14:31.142 19:21:17 -- nvmf/common.sh@447 -- # tail -n +2 00:14:31.142 19:21:17 -- nvmf/common.sh@447 -- # head -n 1 00:14:31.142 19:21:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:31.142 19:21:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:31.142 19:21:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:31.142 19:21:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:31.142 19:21:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:31.142 19:21:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:31.142 19:21:17 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:14:31.142 19:21:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:31.142 19:21:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:31.142 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:14:31.142 19:21:17 -- nvmf/common.sh@470 -- # nvmfpid=3016255 00:14:31.142 19:21:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:14:31.142 19:21:17 -- nvmf/common.sh@471 -- # waitforlisten 3016255 00:14:31.142 19:21:17 -- common/autotest_common.sh@817 -- # '[' -z 3016255 ']' 00:14:31.142 19:21:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:31.142 19:21:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:31.142 19:21:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:31.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:31.142 19:21:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:31.142 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:14:31.142 [2024-04-24 19:21:17.241548] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:14:31.142 [2024-04-24 19:21:17.241637] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:31.142 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.142 [2024-04-24 19:21:17.314419] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:31.142 [2024-04-24 19:21:17.399836] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:31.142 [2024-04-24 19:21:17.399883] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:31.142 [2024-04-24 19:21:17.399892] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:31.142 [2024-04-24 19:21:17.399917] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:31.142 [2024-04-24 19:21:17.399925] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:31.142 [2024-04-24 19:21:17.400044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:31.142 [2024-04-24 19:21:17.400141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:31.142 [2024-04-24 19:21:17.400223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:31.142 [2024-04-24 19:21:17.400224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:31.142 19:21:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:31.142 19:21:18 -- common/autotest_common.sh@850 -- # return 0 00:14:31.142 19:21:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:31.142 19:21:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:31.142 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.142 19:21:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.142 19:21:18 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:31.142 19:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:31.142 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.142 [2024-04-24 19:21:18.120641] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf28b20/0xf2d010) succeed. 00:14:31.142 [2024-04-24 19:21:18.131191] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf2a160/0xf6e6a0) succeed. 00:14:31.452 19:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:31.452 19:21:18 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:31.452 19:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:31.452 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.452 Malloc0 00:14:31.452 19:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:31.452 19:21:18 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:31.452 19:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:31.452 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.452 19:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:31.452 19:21:18 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:31.452 19:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:31.452 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.452 19:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:31.452 19:21:18 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:31.452 19:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:31.452 19:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:31.452 [2024-04-24 19:21:18.306570] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:31.452 19:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:31.452 19:21:18 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:14:31.452 19:21:18 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:14:31.452 19:21:18 -- nvmf/common.sh@521 -- # config=() 00:14:31.452 19:21:18 -- nvmf/common.sh@521 -- # local subsystem config 00:14:31.452 19:21:18 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:31.452 19:21:18 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:31.452 { 00:14:31.452 "params": { 00:14:31.452 "name": "Nvme$subsystem", 00:14:31.452 "trtype": "$TEST_TRANSPORT", 00:14:31.452 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:31.452 "adrfam": "ipv4", 00:14:31.452 "trsvcid": "$NVMF_PORT", 00:14:31.452 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:31.452 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:31.452 "hdgst": ${hdgst:-false}, 00:14:31.452 "ddgst": ${ddgst:-false} 00:14:31.452 }, 00:14:31.452 "method": "bdev_nvme_attach_controller" 00:14:31.452 } 00:14:31.452 EOF 00:14:31.452 )") 00:14:31.452 19:21:18 -- nvmf/common.sh@543 -- # cat 00:14:31.452 19:21:18 -- nvmf/common.sh@545 -- # jq . 00:14:31.452 19:21:18 -- nvmf/common.sh@546 -- # IFS=, 00:14:31.452 19:21:18 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:31.452 "params": { 00:14:31.452 "name": "Nvme1", 00:14:31.452 "trtype": "rdma", 00:14:31.452 "traddr": "192.168.100.8", 00:14:31.452 "adrfam": "ipv4", 00:14:31.452 "trsvcid": "4420", 00:14:31.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:31.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:31.452 "hdgst": false, 00:14:31.452 "ddgst": false 00:14:31.452 }, 00:14:31.452 "method": "bdev_nvme_attach_controller" 00:14:31.452 }' 00:14:31.452 [2024-04-24 19:21:18.357850] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:14:31.452 [2024-04-24 19:21:18.357906] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3016456 ] 00:14:31.452 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.452 [2024-04-24 19:21:18.430824] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:31.716 [2024-04-24 19:21:18.517771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:31.716 [2024-04-24 19:21:18.517858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:31.716 [2024-04-24 19:21:18.517860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:31.716 I/O targets: 00:14:31.716 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:14:31.716 00:14:31.716 00:14:31.716 CUnit - A unit testing framework for C - Version 2.1-3 00:14:31.716 http://cunit.sourceforge.net/ 00:14:31.716 00:14:31.716 00:14:31.716 Suite: bdevio tests on: Nvme1n1 00:14:31.716 Test: blockdev write read block ...passed 00:14:31.716 Test: blockdev write zeroes read block ...passed 00:14:31.716 Test: blockdev write zeroes read no split ...passed 00:14:31.716 Test: blockdev write zeroes read split ...passed 00:14:31.716 Test: blockdev write zeroes read split partial ...passed 00:14:31.975 Test: blockdev reset ...[2024-04-24 19:21:18.737836] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:14:31.975 [2024-04-24 19:21:18.760755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:14:31.975 [2024-04-24 19:21:18.787361] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:31.975 passed 00:14:31.975 Test: blockdev write read 8 blocks ...passed 00:14:31.975 Test: blockdev write read size > 128k ...passed 00:14:31.975 Test: blockdev write read invalid size ...passed 00:14:31.975 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:14:31.975 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:14:31.975 Test: blockdev write read max offset ...passed 00:14:31.975 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:14:31.975 Test: blockdev writev readv 8 blocks ...passed 00:14:31.975 Test: blockdev writev readv 30 x 1block ...passed 00:14:31.975 Test: blockdev writev readv block ...passed 00:14:31.975 Test: blockdev writev readv size > 128k ...passed 00:14:31.975 Test: blockdev writev readv size > 128k in two iovs ...passed 00:14:31.975 Test: blockdev comparev and writev ...[2024-04-24 19:21:18.790354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.790400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.790594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.790618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.790796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.790819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.790828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.791002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.791014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.791024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:31.975 [2024-04-24 19:21:18.791034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:14:31.975 passed 00:14:31.975 Test: blockdev nvme passthru rw ...passed 00:14:31.975 Test: blockdev nvme passthru vendor specific ...[2024-04-24 19:21:18.791322] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:31.975 [2024-04-24 19:21:18.791334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.791375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:31.975 [2024-04-24 19:21:18.791386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.791434] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:31.975 [2024-04-24 19:21:18.791445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:14:31.975 [2024-04-24 19:21:18.791490] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:31.975 [2024-04-24 19:21:18.791501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:14:31.975 passed 00:14:31.975 Test: blockdev nvme admin passthru ...passed 00:14:31.975 Test: blockdev copy ...passed 00:14:31.975 00:14:31.975 Run Summary: Type Total Ran Passed Failed Inactive 00:14:31.975 suites 1 1 n/a 0 0 00:14:31.975 tests 23 23 23 0 0 00:14:31.975 asserts 152 152 152 0 n/a 00:14:31.975 00:14:31.975 Elapsed time = 0.174 seconds 00:14:32.234 19:21:19 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:32.234 19:21:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.234 19:21:19 -- common/autotest_common.sh@10 -- # set +x 00:14:32.234 19:21:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.234 19:21:19 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:14:32.234 19:21:19 -- target/bdevio.sh@30 -- # nvmftestfini 00:14:32.234 19:21:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:32.234 19:21:19 -- nvmf/common.sh@117 -- # sync 00:14:32.234 19:21:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:32.234 19:21:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:32.234 19:21:19 -- nvmf/common.sh@120 -- # set +e 00:14:32.234 19:21:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:32.234 19:21:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:32.234 rmmod nvme_rdma 00:14:32.234 rmmod nvme_fabrics 00:14:32.234 19:21:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:32.234 19:21:19 -- nvmf/common.sh@124 -- # set -e 00:14:32.234 19:21:19 -- nvmf/common.sh@125 -- # return 0 00:14:32.234 19:21:19 -- nvmf/common.sh@478 -- # '[' -n 3016255 ']' 00:14:32.234 19:21:19 -- nvmf/common.sh@479 -- # killprocess 3016255 00:14:32.234 19:21:19 -- common/autotest_common.sh@936 -- # '[' -z 3016255 ']' 00:14:32.234 19:21:19 -- common/autotest_common.sh@940 -- # kill -0 3016255 00:14:32.234 19:21:19 -- common/autotest_common.sh@941 -- # uname 00:14:32.234 19:21:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:32.234 19:21:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3016255 00:14:32.234 19:21:19 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:14:32.234 19:21:19 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:14:32.234 19:21:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3016255' 00:14:32.234 killing process with pid 3016255 00:14:32.234 19:21:19 -- common/autotest_common.sh@955 -- # kill 3016255 00:14:32.234 19:21:19 -- common/autotest_common.sh@960 -- # wait 3016255 00:14:32.234 [2024-04-24 19:21:19.242886] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:32.492 19:21:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:32.492 19:21:19 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:32.492 00:14:32.492 real 0m8.163s 00:14:32.492 user 0m10.935s 00:14:32.492 sys 0m5.062s 00:14:32.492 19:21:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:32.492 19:21:19 -- common/autotest_common.sh@10 -- # set +x 00:14:32.492 ************************************ 00:14:32.492 END TEST nvmf_bdevio 00:14:32.492 ************************************ 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:14:32.751 19:21:19 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:14:32.751 19:21:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:32.751 19:21:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:32.751 19:21:19 -- common/autotest_common.sh@10 -- # set +x 00:14:32.751 ************************************ 00:14:32.751 START TEST nvmf_device_removal 00:14:32.751 ************************************ 00:14:32.751 19:21:19 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:14:32.751 * Looking for test storage... 00:14:32.751 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:32.751 19:21:19 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:14:32.751 19:21:19 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:14:32.751 19:21:19 -- common/autotest_common.sh@34 -- # set -e 00:14:32.751 19:21:19 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:14:32.751 19:21:19 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:14:32.751 19:21:19 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:14:32.751 19:21:19 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:14:32.751 19:21:19 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:14:32.751 19:21:19 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:14:32.751 19:21:19 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:14:32.751 19:21:19 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:14:32.751 19:21:19 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:14:32.751 19:21:19 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:14:32.751 19:21:19 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:14:32.751 19:21:19 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:14:32.751 19:21:19 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:14:32.751 19:21:19 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:14:32.751 19:21:19 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:14:32.751 19:21:19 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:14:32.751 19:21:19 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:14:32.751 19:21:19 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:14:32.751 19:21:19 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:14:32.751 19:21:19 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:14:32.751 19:21:19 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:14:32.751 19:21:19 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:14:32.751 19:21:19 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:14:32.751 19:21:19 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:14:32.751 19:21:19 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:14:32.751 19:21:19 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:14:32.751 19:21:19 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:14:32.751 19:21:19 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:14:32.751 19:21:19 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:14:32.751 19:21:19 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:14:32.751 19:21:19 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:14:32.751 19:21:19 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:14:32.751 19:21:19 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:14:32.751 19:21:19 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:14:32.751 19:21:19 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:14:32.751 19:21:19 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:14:32.751 19:21:19 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:14:32.751 19:21:19 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:14:32.751 19:21:19 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:14:32.751 19:21:19 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:14:32.751 19:21:19 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:14:32.751 19:21:19 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:14:32.751 19:21:19 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:14:32.751 19:21:19 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:14:32.751 19:21:19 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:14:32.751 19:21:19 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:14:32.751 19:21:19 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:14:32.751 19:21:19 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:14:32.751 19:21:19 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:14:32.752 19:21:19 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:14:32.752 19:21:19 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:14:32.752 19:21:19 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:14:32.752 19:21:19 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:14:32.752 19:21:19 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:14:33.013 19:21:19 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:14:33.013 19:21:19 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:14:33.013 19:21:19 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:14:33.013 19:21:19 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:14:33.013 19:21:19 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:14:33.013 19:21:19 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:14:33.013 19:21:19 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:14:33.014 19:21:19 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:14:33.014 19:21:19 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:14:33.014 19:21:19 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:14:33.014 19:21:19 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:14:33.014 19:21:19 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:14:33.014 19:21:19 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:14:33.014 19:21:19 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:14:33.014 19:21:19 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:14:33.014 19:21:19 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:14:33.014 19:21:19 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:14:33.014 19:21:19 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:14:33.014 19:21:19 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:14:33.014 19:21:19 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:14:33.014 19:21:19 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:14:33.014 19:21:19 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:14:33.014 19:21:19 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:14:33.014 19:21:19 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:14:33.014 19:21:19 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:14:33.014 19:21:19 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:14:33.014 19:21:19 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:14:33.014 19:21:19 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:14:33.014 19:21:19 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:14:33.014 19:21:19 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:14:33.014 19:21:19 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:14:33.014 19:21:19 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:14:33.014 19:21:19 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:14:33.014 19:21:19 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:14:33.014 19:21:19 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:14:33.014 19:21:19 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:14:33.014 19:21:19 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:14:33.014 19:21:19 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:14:33.014 19:21:19 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:33.014 19:21:19 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:14:33.014 19:21:19 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:33.014 19:21:19 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:14:33.014 19:21:19 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:14:33.014 19:21:19 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:14:33.014 19:21:19 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:14:33.014 19:21:19 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:14:33.014 19:21:19 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:14:33.014 19:21:19 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:14:33.014 19:21:19 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:14:33.014 #define SPDK_CONFIG_H 00:14:33.014 #define SPDK_CONFIG_APPS 1 00:14:33.014 #define SPDK_CONFIG_ARCH native 00:14:33.014 #undef SPDK_CONFIG_ASAN 00:14:33.014 #undef SPDK_CONFIG_AVAHI 00:14:33.014 #undef SPDK_CONFIG_CET 00:14:33.014 #define SPDK_CONFIG_COVERAGE 1 00:14:33.014 #define SPDK_CONFIG_CROSS_PREFIX 00:14:33.014 #undef SPDK_CONFIG_CRYPTO 00:14:33.014 #undef SPDK_CONFIG_CRYPTO_MLX5 00:14:33.014 #undef SPDK_CONFIG_CUSTOMOCF 00:14:33.014 #undef SPDK_CONFIG_DAOS 00:14:33.014 #define SPDK_CONFIG_DAOS_DIR 00:14:33.014 #define SPDK_CONFIG_DEBUG 1 00:14:33.014 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:14:33.014 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:14:33.014 #define SPDK_CONFIG_DPDK_INC_DIR 00:14:33.014 #define SPDK_CONFIG_DPDK_LIB_DIR 00:14:33.014 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:14:33.014 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:14:33.014 #define SPDK_CONFIG_EXAMPLES 1 00:14:33.014 #undef SPDK_CONFIG_FC 00:14:33.014 #define SPDK_CONFIG_FC_PATH 00:14:33.014 #define SPDK_CONFIG_FIO_PLUGIN 1 00:14:33.014 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:14:33.014 #undef SPDK_CONFIG_FUSE 00:14:33.014 #undef SPDK_CONFIG_FUZZER 00:14:33.014 #define SPDK_CONFIG_FUZZER_LIB 00:14:33.014 #undef SPDK_CONFIG_GOLANG 00:14:33.014 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:14:33.014 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:14:33.014 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:14:33.014 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:14:33.014 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:14:33.014 #undef SPDK_CONFIG_HAVE_LIBBSD 00:14:33.014 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:14:33.014 #define SPDK_CONFIG_IDXD 1 00:14:33.014 #undef SPDK_CONFIG_IDXD_KERNEL 00:14:33.014 #undef SPDK_CONFIG_IPSEC_MB 00:14:33.014 #define SPDK_CONFIG_IPSEC_MB_DIR 00:14:33.014 #define SPDK_CONFIG_ISAL 1 00:14:33.014 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:14:33.014 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:14:33.014 #define SPDK_CONFIG_LIBDIR 00:14:33.014 #undef SPDK_CONFIG_LTO 00:14:33.014 #define SPDK_CONFIG_MAX_LCORES 00:14:33.014 #define SPDK_CONFIG_NVME_CUSE 1 00:14:33.014 #undef SPDK_CONFIG_OCF 00:14:33.014 #define SPDK_CONFIG_OCF_PATH 00:14:33.014 #define SPDK_CONFIG_OPENSSL_PATH 00:14:33.014 #undef SPDK_CONFIG_PGO_CAPTURE 00:14:33.014 #define SPDK_CONFIG_PGO_DIR 00:14:33.014 #undef SPDK_CONFIG_PGO_USE 00:14:33.014 #define SPDK_CONFIG_PREFIX /usr/local 00:14:33.014 #undef SPDK_CONFIG_RAID5F 00:14:33.014 #undef SPDK_CONFIG_RBD 00:14:33.014 #define SPDK_CONFIG_RDMA 1 00:14:33.014 #define SPDK_CONFIG_RDMA_PROV verbs 00:14:33.014 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:14:33.014 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:14:33.014 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:14:33.014 #define SPDK_CONFIG_SHARED 1 00:14:33.014 #undef SPDK_CONFIG_SMA 00:14:33.014 #define SPDK_CONFIG_TESTS 1 00:14:33.014 #undef SPDK_CONFIG_TSAN 00:14:33.014 #define SPDK_CONFIG_UBLK 1 00:14:33.014 #define SPDK_CONFIG_UBSAN 1 00:14:33.014 #undef SPDK_CONFIG_UNIT_TESTS 00:14:33.014 #undef SPDK_CONFIG_URING 00:14:33.014 #define SPDK_CONFIG_URING_PATH 00:14:33.014 #undef SPDK_CONFIG_URING_ZNS 00:14:33.014 #undef SPDK_CONFIG_USDT 00:14:33.014 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:14:33.014 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:14:33.014 #undef SPDK_CONFIG_VFIO_USER 00:14:33.014 #define SPDK_CONFIG_VFIO_USER_DIR 00:14:33.014 #define SPDK_CONFIG_VHOST 1 00:14:33.014 #define SPDK_CONFIG_VIRTIO 1 00:14:33.014 #undef SPDK_CONFIG_VTUNE 00:14:33.014 #define SPDK_CONFIG_VTUNE_DIR 00:14:33.014 #define SPDK_CONFIG_WERROR 1 00:14:33.014 #define SPDK_CONFIG_WPDK_DIR 00:14:33.014 #undef SPDK_CONFIG_XNVME 00:14:33.014 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:14:33.014 19:21:19 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:14:33.014 19:21:19 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:33.014 19:21:19 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:33.014 19:21:19 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:33.014 19:21:19 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:33.014 19:21:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.014 19:21:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.014 19:21:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.014 19:21:19 -- paths/export.sh@5 -- # export PATH 00:14:33.014 19:21:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.014 19:21:19 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:14:33.014 19:21:19 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:14:33.014 19:21:19 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:14:33.014 19:21:19 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:14:33.014 19:21:19 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:14:33.015 19:21:19 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:14:33.015 19:21:19 -- pm/common@67 -- # TEST_TAG=N/A 00:14:33.015 19:21:19 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:14:33.015 19:21:19 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:14:33.015 19:21:19 -- pm/common@71 -- # uname -s 00:14:33.015 19:21:19 -- pm/common@71 -- # PM_OS=Linux 00:14:33.015 19:21:19 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:14:33.015 19:21:19 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:14:33.015 19:21:19 -- pm/common@76 -- # [[ Linux == Linux ]] 00:14:33.015 19:21:19 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:14:33.015 19:21:19 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:14:33.015 19:21:19 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:14:33.015 19:21:19 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:14:33.015 19:21:19 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:14:33.015 19:21:19 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:14:33.015 19:21:19 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:14:33.015 19:21:19 -- common/autotest_common.sh@57 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:14:33.015 19:21:19 -- common/autotest_common.sh@61 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:14:33.015 19:21:19 -- common/autotest_common.sh@63 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:14:33.015 19:21:19 -- common/autotest_common.sh@65 -- # : 1 00:14:33.015 19:21:19 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:14:33.015 19:21:19 -- common/autotest_common.sh@67 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:14:33.015 19:21:19 -- common/autotest_common.sh@69 -- # : 00:14:33.015 19:21:19 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:14:33.015 19:21:19 -- common/autotest_common.sh@71 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:14:33.015 19:21:19 -- common/autotest_common.sh@73 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:14:33.015 19:21:19 -- common/autotest_common.sh@75 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:14:33.015 19:21:19 -- common/autotest_common.sh@77 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:14:33.015 19:21:19 -- common/autotest_common.sh@79 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:14:33.015 19:21:19 -- common/autotest_common.sh@81 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:14:33.015 19:21:19 -- common/autotest_common.sh@83 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:14:33.015 19:21:19 -- common/autotest_common.sh@85 -- # : 1 00:14:33.015 19:21:19 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:14:33.015 19:21:19 -- common/autotest_common.sh@87 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:14:33.015 19:21:19 -- common/autotest_common.sh@89 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:14:33.015 19:21:19 -- common/autotest_common.sh@91 -- # : 1 00:14:33.015 19:21:19 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:14:33.015 19:21:19 -- common/autotest_common.sh@93 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:14:33.015 19:21:19 -- common/autotest_common.sh@95 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:14:33.015 19:21:19 -- common/autotest_common.sh@97 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:14:33.015 19:21:19 -- common/autotest_common.sh@99 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:14:33.015 19:21:19 -- common/autotest_common.sh@101 -- # : rdma 00:14:33.015 19:21:19 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:14:33.015 19:21:19 -- common/autotest_common.sh@103 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:14:33.015 19:21:19 -- common/autotest_common.sh@105 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:14:33.015 19:21:19 -- common/autotest_common.sh@107 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:14:33.015 19:21:19 -- common/autotest_common.sh@109 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:14:33.015 19:21:19 -- common/autotest_common.sh@111 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:14:33.015 19:21:19 -- common/autotest_common.sh@113 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:14:33.015 19:21:19 -- common/autotest_common.sh@115 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:14:33.015 19:21:19 -- common/autotest_common.sh@117 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:14:33.015 19:21:19 -- common/autotest_common.sh@119 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:14:33.015 19:21:19 -- common/autotest_common.sh@121 -- # : 1 00:14:33.015 19:21:19 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:14:33.015 19:21:19 -- common/autotest_common.sh@123 -- # : 00:14:33.015 19:21:19 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:14:33.015 19:21:19 -- common/autotest_common.sh@125 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:14:33.015 19:21:19 -- common/autotest_common.sh@127 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:14:33.015 19:21:19 -- common/autotest_common.sh@129 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:14:33.015 19:21:19 -- common/autotest_common.sh@131 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:14:33.015 19:21:19 -- common/autotest_common.sh@133 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:14:33.015 19:21:19 -- common/autotest_common.sh@135 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:14:33.015 19:21:19 -- common/autotest_common.sh@137 -- # : 00:14:33.015 19:21:19 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:14:33.015 19:21:19 -- common/autotest_common.sh@139 -- # : true 00:14:33.015 19:21:19 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:14:33.015 19:21:19 -- common/autotest_common.sh@141 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:14:33.015 19:21:19 -- common/autotest_common.sh@143 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:14:33.015 19:21:19 -- common/autotest_common.sh@145 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:14:33.015 19:21:19 -- common/autotest_common.sh@147 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:14:33.015 19:21:19 -- common/autotest_common.sh@149 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:14:33.015 19:21:19 -- common/autotest_common.sh@151 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:14:33.015 19:21:19 -- common/autotest_common.sh@153 -- # : mlx5 00:14:33.015 19:21:19 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:14:33.015 19:21:19 -- common/autotest_common.sh@155 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:14:33.015 19:21:19 -- common/autotest_common.sh@157 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:14:33.015 19:21:19 -- common/autotest_common.sh@159 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:14:33.015 19:21:19 -- common/autotest_common.sh@161 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:14:33.015 19:21:19 -- common/autotest_common.sh@163 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:14:33.015 19:21:19 -- common/autotest_common.sh@166 -- # : 00:14:33.015 19:21:19 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:14:33.015 19:21:19 -- common/autotest_common.sh@168 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:14:33.015 19:21:19 -- common/autotest_common.sh@170 -- # : 0 00:14:33.015 19:21:19 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:14:33.015 19:21:19 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:33.015 19:21:19 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:33.016 19:21:19 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:33.016 19:21:19 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:14:33.016 19:21:19 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:14:33.016 19:21:19 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:14:33.016 19:21:19 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:14:33.016 19:21:19 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:33.016 19:21:19 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:33.016 19:21:19 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:33.016 19:21:19 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:33.016 19:21:19 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:14:33.016 19:21:19 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:14:33.016 19:21:19 -- common/autotest_common.sh@199 -- # cat 00:14:33.016 19:21:19 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:14:33.016 19:21:19 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:33.016 19:21:19 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:33.016 19:21:19 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:33.016 19:21:19 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:33.016 19:21:19 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:14:33.016 19:21:19 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:14:33.016 19:21:19 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:33.016 19:21:19 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:33.016 19:21:19 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:33.016 19:21:19 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:33.016 19:21:19 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:33.016 19:21:19 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:33.016 19:21:19 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:33.016 19:21:19 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:33.016 19:21:19 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:14:33.016 19:21:19 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:14:33.016 19:21:19 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:14:33.016 19:21:19 -- common/autotest_common.sh@252 -- # export valgrind= 00:14:33.016 19:21:19 -- common/autotest_common.sh@252 -- # valgrind= 00:14:33.016 19:21:19 -- common/autotest_common.sh@258 -- # uname -s 00:14:33.016 19:21:19 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:14:33.016 19:21:19 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:14:33.016 19:21:19 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:14:33.016 19:21:19 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@268 -- # MAKE=make 00:14:33.016 19:21:19 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:14:33.016 19:21:19 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:14:33.016 19:21:19 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:14:33.016 19:21:19 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:14:33.016 19:21:19 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:14:33.016 19:21:19 -- common/autotest_common.sh@289 -- # for i in "$@" 00:14:33.016 19:21:19 -- common/autotest_common.sh@290 -- # case "$i" in 00:14:33.016 19:21:19 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:14:33.016 19:21:19 -- common/autotest_common.sh@307 -- # [[ -z 3016697 ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@307 -- # kill -0 3016697 00:14:33.016 19:21:19 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:14:33.016 19:21:19 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:14:33.016 19:21:19 -- common/autotest_common.sh@320 -- # local mount target_dir 00:14:33.016 19:21:19 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:14:33.016 19:21:19 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:14:33.016 19:21:19 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:14:33.016 19:21:19 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:14:33.016 19:21:19 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.ZRwIFu 00:14:33.016 19:21:19 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:14:33.016 19:21:19 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:14:33.016 19:21:19 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.ZRwIFu/tests/target /tmp/spdk.ZRwIFu 00:14:33.016 19:21:19 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@316 -- # df -T 00:14:33.016 19:21:19 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=989405184 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=4295024640 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=52065697792 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=61742698496 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=9677000704 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/sda1 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=xfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=221821267968 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=239938535424 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=18117267456 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=30856716288 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871347200 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=14630912 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=12325650432 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=12348542976 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=22892544 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=30871003136 00:14:33.016 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871351296 00:14:33.016 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=348160 00:14:33.016 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.016 19:21:19 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:14:33.017 19:21:19 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:14:33.017 19:21:19 -- common/autotest_common.sh@351 -- # avails["$mount"]=6174265344 00:14:33.017 19:21:19 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6174269440 00:14:33.017 19:21:19 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:14:33.017 19:21:19 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:14:33.017 19:21:19 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:14:33.017 * Looking for test storage... 00:14:33.017 19:21:19 -- common/autotest_common.sh@357 -- # local target_space new_size 00:14:33.017 19:21:19 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:14:33.017 19:21:19 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.017 19:21:19 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:14:33.017 19:21:19 -- common/autotest_common.sh@361 -- # mount=/ 00:14:33.017 19:21:19 -- common/autotest_common.sh@363 -- # target_space=52065697792 00:14:33.017 19:21:19 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:14:33.017 19:21:19 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:14:33.017 19:21:19 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:14:33.017 19:21:19 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:14:33.017 19:21:19 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:14:33.017 19:21:19 -- common/autotest_common.sh@370 -- # new_size=11891593216 00:14:33.017 19:21:19 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:14:33.017 19:21:19 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.017 19:21:19 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.017 19:21:19 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.017 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.017 19:21:19 -- common/autotest_common.sh@378 -- # return 0 00:14:33.017 19:21:19 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:14:33.017 19:21:19 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:14:33.017 19:21:19 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:14:33.017 19:21:19 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:14:33.017 19:21:19 -- common/autotest_common.sh@1673 -- # true 00:14:33.017 19:21:19 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:14:33.017 19:21:19 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:14:33.017 19:21:19 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:14:33.017 19:21:19 -- common/autotest_common.sh@27 -- # exec 00:14:33.017 19:21:19 -- common/autotest_common.sh@29 -- # exec 00:14:33.017 19:21:19 -- common/autotest_common.sh@31 -- # xtrace_restore 00:14:33.017 19:21:19 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:14:33.017 19:21:19 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:14:33.017 19:21:19 -- common/autotest_common.sh@18 -- # set -x 00:14:33.017 19:21:19 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:33.017 19:21:19 -- nvmf/common.sh@7 -- # uname -s 00:14:33.017 19:21:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:33.017 19:21:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:33.017 19:21:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:33.017 19:21:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:33.017 19:21:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:33.017 19:21:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:33.017 19:21:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:33.017 19:21:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:33.017 19:21:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:33.017 19:21:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:33.017 19:21:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:14:33.017 19:21:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:14:33.017 19:21:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:33.017 19:21:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:33.017 19:21:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:33.017 19:21:19 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:33.017 19:21:19 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:33.017 19:21:19 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:33.017 19:21:19 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:33.017 19:21:19 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:33.017 19:21:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.017 19:21:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.017 19:21:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.017 19:21:19 -- paths/export.sh@5 -- # export PATH 00:14:33.017 19:21:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.017 19:21:19 -- nvmf/common.sh@47 -- # : 0 00:14:33.017 19:21:19 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:33.017 19:21:19 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:33.017 19:21:19 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:33.017 19:21:19 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:33.017 19:21:19 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:33.017 19:21:19 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:33.017 19:21:19 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:33.017 19:21:19 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:33.017 19:21:19 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:14:33.017 19:21:19 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:14:33.017 19:21:19 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:33.017 19:21:19 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:14:33.017 19:21:19 -- target/device_removal.sh@18 -- # nvmftestinit 00:14:33.017 19:21:19 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:33.017 19:21:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:33.017 19:21:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:33.017 19:21:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:33.017 19:21:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:33.017 19:21:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.017 19:21:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.017 19:21:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.017 19:21:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:33.017 19:21:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:33.017 19:21:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:33.017 19:21:19 -- common/autotest_common.sh@10 -- # set +x 00:14:39.585 19:21:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.585 19:21:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:39.585 19:21:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:39.585 19:21:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:39.585 19:21:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:39.585 19:21:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:39.585 19:21:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:39.585 19:21:25 -- nvmf/common.sh@295 -- # net_devs=() 00:14:39.585 19:21:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:39.585 19:21:25 -- nvmf/common.sh@296 -- # e810=() 00:14:39.585 19:21:25 -- nvmf/common.sh@296 -- # local -ga e810 00:14:39.585 19:21:25 -- nvmf/common.sh@297 -- # x722=() 00:14:39.585 19:21:25 -- nvmf/common.sh@297 -- # local -ga x722 00:14:39.585 19:21:25 -- nvmf/common.sh@298 -- # mlx=() 00:14:39.585 19:21:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:39.585 19:21:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.585 19:21:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:39.585 19:21:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:39.585 19:21:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:39.585 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:39.585 19:21:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:39.585 19:21:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:39.585 19:21:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:39.585 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:39.585 19:21:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:39.585 19:21:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:39.585 19:21:25 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:39.585 19:21:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.585 19:21:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:39.585 19:21:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.585 19:21:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:39.585 Found net devices under 0000:18:00.0: mlx_0_0 00:14:39.585 19:21:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:39.585 19:21:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.585 19:21:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:39.585 19:21:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.585 19:21:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:39.585 Found net devices under 0000:18:00.1: mlx_0_1 00:14:39.585 19:21:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.585 19:21:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:39.585 19:21:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:39.585 19:21:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:39.585 19:21:25 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:39.586 19:21:25 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:39.586 19:21:25 -- nvmf/common.sh@58 -- # uname 00:14:39.586 19:21:25 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:39.586 19:21:25 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:39.586 19:21:25 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:39.586 19:21:25 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:39.586 19:21:25 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:39.586 19:21:25 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:39.586 19:21:25 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:39.586 19:21:25 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:39.586 19:21:25 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:39.586 19:21:25 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:39.586 19:21:25 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:39.586 19:21:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:39.586 19:21:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:39.586 19:21:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:39.586 19:21:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:39.586 19:21:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:39.586 19:21:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@105 -- # continue 2 00:14:39.586 19:21:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@105 -- # continue 2 00:14:39.586 19:21:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:39.586 19:21:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.586 19:21:25 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:39.586 19:21:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:39.586 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:39.586 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:14:39.586 altname enp24s0f0np0 00:14:39.586 altname ens785f0np0 00:14:39.586 inet 192.168.100.8/24 scope global mlx_0_0 00:14:39.586 valid_lft forever preferred_lft forever 00:14:39.586 19:21:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:39.586 19:21:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.586 19:21:25 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:39.586 19:21:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:39.586 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:39.586 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:14:39.586 altname enp24s0f1np1 00:14:39.586 altname ens785f1np1 00:14:39.586 inet 192.168.100.9/24 scope global mlx_0_1 00:14:39.586 valid_lft forever preferred_lft forever 00:14:39.586 19:21:25 -- nvmf/common.sh@411 -- # return 0 00:14:39.586 19:21:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:39.586 19:21:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:39.586 19:21:25 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:39.586 19:21:25 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:39.586 19:21:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:39.586 19:21:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:39.586 19:21:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:39.586 19:21:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:39.586 19:21:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:39.586 19:21:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@105 -- # continue 2 00:14:39.586 19:21:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.586 19:21:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:39.586 19:21:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@105 -- # continue 2 00:14:39.586 19:21:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:39.586 19:21:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.586 19:21:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:39.586 19:21:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:39.586 19:21:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.586 19:21:25 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:39.586 192.168.100.9' 00:14:39.586 19:21:25 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:39.586 192.168.100.9' 00:14:39.586 19:21:25 -- nvmf/common.sh@446 -- # head -n 1 00:14:39.586 19:21:25 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:39.586 19:21:25 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:39.586 192.168.100.9' 00:14:39.586 19:21:25 -- nvmf/common.sh@447 -- # tail -n +2 00:14:39.586 19:21:25 -- nvmf/common.sh@447 -- # head -n 1 00:14:39.586 19:21:25 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:39.586 19:21:25 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:39.586 19:21:25 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:39.586 19:21:25 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:39.586 19:21:25 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:39.586 19:21:25 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:39.586 19:21:25 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:14:39.586 19:21:25 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:14:39.586 19:21:25 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:14:39.586 19:21:25 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:14:39.586 19:21:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:39.586 19:21:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:39.586 19:21:25 -- common/autotest_common.sh@10 -- # set +x 00:14:39.586 ************************************ 00:14:39.586 START TEST nvmf_device_removal_pci_remove_no_srq 00:14:39.586 ************************************ 00:14:39.586 19:21:25 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:14:39.586 19:21:25 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:14:39.586 19:21:25 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:39.586 19:21:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:39.586 19:21:25 -- common/autotest_common.sh@10 -- # set +x 00:14:39.586 19:21:25 -- nvmf/common.sh@470 -- # nvmfpid=3019571 00:14:39.586 19:21:25 -- nvmf/common.sh@471 -- # waitforlisten 3019571 00:14:39.586 19:21:25 -- common/autotest_common.sh@817 -- # '[' -z 3019571 ']' 00:14:39.586 19:21:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:39.586 19:21:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:39.586 19:21:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:39.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:39.586 19:21:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:39.586 19:21:25 -- common/autotest_common.sh@10 -- # set +x 00:14:39.586 19:21:25 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:39.586 [2024-04-24 19:21:26.000146] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:14:39.586 [2024-04-24 19:21:26.000197] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:39.586 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.586 [2024-04-24 19:21:26.071334] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:39.586 [2024-04-24 19:21:26.159931] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:39.586 [2024-04-24 19:21:26.159971] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:39.586 [2024-04-24 19:21:26.159980] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:39.586 [2024-04-24 19:21:26.160005] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:39.586 [2024-04-24 19:21:26.160013] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:39.586 [2024-04-24 19:21:26.160067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:39.586 [2024-04-24 19:21:26.160070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:39.845 19:21:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:39.845 19:21:26 -- common/autotest_common.sh@850 -- # return 0 00:14:39.845 19:21:26 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:39.845 19:21:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:39.845 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:14:39.845 19:21:26 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:39.845 19:21:26 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:14:39.845 19:21:26 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:14:39.845 19:21:26 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:14:39.845 19:21:26 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:14:39.845 19:21:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.845 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:14:40.105 [2024-04-24 19:21:26.875001] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xe91c60/0xe96150) succeed. 00:14:40.105 [2024-04-24 19:21:26.883961] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xe93160/0xed77e0) succeed. 00:14:40.105 19:21:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.105 19:21:26 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:14:40.105 19:21:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:40.105 19:21:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:40.105 19:21:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:40.105 19:21:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:40.105 19:21:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:40.105 19:21:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:40.105 19:21:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:40.105 19:21:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:40.105 19:21:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:40.105 19:21:26 -- nvmf/common.sh@105 -- # continue 2 00:14:40.105 19:21:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:40.105 19:21:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:40.105 19:21:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:40.105 19:21:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:40.105 19:21:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:40.105 19:21:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:40.105 19:21:26 -- nvmf/common.sh@105 -- # continue 2 00:14:40.105 19:21:26 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:14:40.105 19:21:26 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@25 -- # local -a dev_name 00:14:40.105 19:21:26 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:14:40.105 19:21:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:40.105 19:21:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:40.105 19:21:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:40.105 19:21:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:40.105 19:21:26 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:14:40.105 19:21:26 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:14:40.105 19:21:26 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:14:40.105 19:21:26 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:14:40.105 19:21:26 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:14:40.105 19:21:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.105 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:14:40.105 19:21:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.105 19:21:26 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:14:40.105 19:21:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.105 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:14:40.105 19:21:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.105 19:21:26 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:14:40.105 19:21:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.105 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:14:40.105 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.105 19:21:27 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:14:40.105 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.105 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:40.105 [2024-04-24 19:21:27.012327] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:40.105 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.105 19:21:27 -- target/device_removal.sh@41 -- # return 0 00:14:40.105 19:21:27 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:14:40.105 19:21:27 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:14:40.105 19:21:27 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@25 -- # local -a dev_name 00:14:40.105 19:21:27 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:14:40.105 19:21:27 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:14:40.106 19:21:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:40.106 19:21:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:40.106 19:21:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:40.106 19:21:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:40.106 19:21:27 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:14:40.106 19:21:27 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:14:40.106 19:21:27 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:14:40.106 19:21:27 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:14:40.106 19:21:27 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:14:40.106 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.106 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:40.106 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.106 19:21:27 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:14:40.106 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.106 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:40.106 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.106 19:21:27 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:14:40.106 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.106 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:40.106 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.106 19:21:27 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:14:40.106 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.106 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:40.106 [2024-04-24 19:21:27.097124] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:14:40.106 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.106 19:21:27 -- target/device_removal.sh@41 -- # return 0 00:14:40.106 19:21:27 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:14:40.106 19:21:27 -- target/device_removal.sh@53 -- # return 0 00:14:40.106 19:21:27 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:14:40.106 19:21:27 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:14:40.106 19:21:27 -- target/device_removal.sh@87 -- # local dev_names 00:14:40.106 19:21:27 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:40.106 19:21:27 -- target/device_removal.sh@91 -- # bdevperf_pid=3019695 00:14:40.106 19:21:27 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:40.106 19:21:27 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:14:40.106 19:21:27 -- target/device_removal.sh@94 -- # waitforlisten 3019695 /var/tmp/bdevperf.sock 00:14:40.106 19:21:27 -- common/autotest_common.sh@817 -- # '[' -z 3019695 ']' 00:14:40.106 19:21:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:40.106 19:21:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:40.106 19:21:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:40.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:40.106 19:21:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:40.106 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:41.041 19:21:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:41.041 19:21:27 -- common/autotest_common.sh@850 -- # return 0 00:14:41.041 19:21:27 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:14:41.041 19:21:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:41.041 19:21:27 -- common/autotest_common.sh@10 -- # set +x 00:14:41.041 19:21:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:41.041 19:21:27 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:14:41.041 19:21:27 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:14:41.041 19:21:27 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:14:41.041 19:21:27 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:14:41.041 19:21:27 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:14:41.041 19:21:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:41.041 19:21:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:41.041 19:21:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:41.041 19:21:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:41.041 19:21:28 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:14:41.041 19:21:28 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:14:41.041 19:21:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:41.041 19:21:28 -- common/autotest_common.sh@10 -- # set +x 00:14:41.300 Nvme_mlx_0_0n1 00:14:41.300 19:21:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:41.300 19:21:28 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:14:41.300 19:21:28 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:14:41.300 19:21:28 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:14:41.300 19:21:28 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:14:41.300 19:21:28 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:14:41.300 19:21:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:41.300 19:21:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:41.300 19:21:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:41.300 19:21:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:41.300 19:21:28 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:14:41.300 19:21:28 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:14:41.300 19:21:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:41.300 19:21:28 -- common/autotest_common.sh@10 -- # set +x 00:14:41.300 Nvme_mlx_0_1n1 00:14:41.300 19:21:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:41.300 19:21:28 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3019826 00:14:41.300 19:21:28 -- target/device_removal.sh@112 -- # sleep 5 00:14:41.300 19:21:28 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:14:46.573 19:21:33 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:14:46.573 19:21:33 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:46.573 19:21:33 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:14:46.573 19:21:33 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:14:46.573 19:21:33 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:14:46.573 19:21:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:46.573 19:21:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:46.573 19:21:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:46.573 19:21:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:46.573 19:21:33 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:14:46.573 19:21:33 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:46.573 19:21:33 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:14:46.573 19:21:33 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:14:46.573 19:21:33 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:14:46.573 19:21:33 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:14:46.573 19:21:33 -- target/device_removal.sh@77 -- # grep mlx5_0 00:14:46.573 19:21:33 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:14:46.573 19:21:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.573 19:21:33 -- common/autotest_common.sh@10 -- # set +x 00:14:46.573 19:21:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:46.573 mlx5_0 00:14:46.573 19:21:33 -- target/device_removal.sh@78 -- # return 0 00:14:46.573 19:21:33 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@67 -- # echo 1 00:14:46.573 19:21:33 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:46.573 19:21:33 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:46.573 [2024-04-24 19:21:33.353381] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:14:46.573 [2024-04-24 19:21:33.353906] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:14:46.573 [2024-04-24 19:21:33.355710] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:14:53.137 19:21:38 -- target/device_removal.sh@147 -- # seq 1 10 00:14:53.137 19:21:38 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:14:53.137 19:21:38 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:14:53.137 19:21:38 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:14:53.137 19:21:38 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:14:53.137 19:21:38 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:14:53.137 19:21:38 -- target/device_removal.sh@77 -- # grep mlx5_0 00:14:53.137 19:21:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:53.137 19:21:38 -- common/autotest_common.sh@10 -- # set +x 00:14:53.137 19:21:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:53.137 19:21:38 -- target/device_removal.sh@78 -- # return 1 00:14:53.137 19:21:38 -- target/device_removal.sh@149 -- # break 00:14:53.137 19:21:38 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:14:53.137 19:21:38 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:14:53.137 19:21:38 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:14:53.137 19:21:38 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:14:53.137 19:21:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:53.137 19:21:38 -- common/autotest_common.sh@10 -- # set +x 00:14:53.137 19:21:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:53.137 19:21:39 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:14:53.138 19:21:39 -- target/device_removal.sh@160 -- # rescan_pci 00:14:53.138 19:21:39 -- target/device_removal.sh@57 -- # echo 1 00:14:53.138 [2024-04-24 19:21:39.934852] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x102f460, err 11. Skip rescan. 00:14:53.138 19:21:40 -- target/device_removal.sh@162 -- # seq 1 10 00:14:53.138 19:21:40 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:14:53.138 19:21:40 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:14:53.138 19:21:40 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:14:53.138 19:21:40 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:14:53.138 19:21:40 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:14:53.138 19:21:40 -- target/device_removal.sh@171 -- # break 00:14:53.138 19:21:40 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:14:53.138 19:21:40 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:14:53.397 [2024-04-24 19:21:40.299784] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x101dbf0/0xe96150) succeed. 00:14:53.397 [2024-04-24 19:21:40.299867] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:14:56.683 19:21:43 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:14:56.683 19:21:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:56.683 19:21:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:56.683 19:21:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:56.683 19:21:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:56.683 19:21:43 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:14:56.683 19:21:43 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:14:56.683 19:21:43 -- target/device_removal.sh@186 -- # seq 1 10 00:14:56.683 19:21:43 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:14:56.684 19:21:43 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:14:56.684 19:21:43 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:14:56.684 19:21:43 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:14:56.684 19:21:43 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:14:56.684 19:21:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.684 19:21:43 -- common/autotest_common.sh@10 -- # set +x 00:14:56.684 [2024-04-24 19:21:43.324576] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:56.684 [2024-04-24 19:21:43.324621] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:14:56.684 [2024-04-24 19:21:43.324643] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:14:56.684 [2024-04-24 19:21:43.324661] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:14:56.684 19:21:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.684 19:21:43 -- target/device_removal.sh@187 -- # ib_count=2 00:14:56.684 19:21:43 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:14:56.684 19:21:43 -- target/device_removal.sh@189 -- # break 00:14:56.684 19:21:43 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:14:56.684 19:21:43 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:14:56.684 19:21:43 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:14:56.684 19:21:43 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:14:56.684 19:21:43 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:14:56.684 19:21:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:56.684 19:21:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:56.684 19:21:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:56.684 19:21:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:56.684 19:21:43 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:14:56.684 19:21:43 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:14:56.684 19:21:43 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:14:56.684 19:21:43 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:14:56.684 19:21:43 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:14:56.684 19:21:43 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:14:56.684 19:21:43 -- target/device_removal.sh@77 -- # grep mlx5_1 00:14:56.684 19:21:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.684 19:21:43 -- common/autotest_common.sh@10 -- # set +x 00:14:56.684 19:21:43 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:14:56.684 19:21:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.684 mlx5_1 00:14:56.684 19:21:43 -- target/device_removal.sh@78 -- # return 0 00:14:56.684 19:21:43 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@67 -- # echo 1 00:14:56.684 19:21:43 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:14:56.684 19:21:43 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:14:56.684 [2024-04-24 19:21:43.509198] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:14:56.684 [2024-04-24 19:21:43.509267] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:14:56.684 [2024-04-24 19:21:43.516246] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:14:56.684 [2024-04-24 19:21:43.516262] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 95 00:14:56.684 [2024-04-24 19:21:43.516270] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:14:56.684 [2024-04-24 19:21:43.516278] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516286] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516294] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516302] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516309] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516316] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516323] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516331] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516339] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516346] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516353] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516360] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516367] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516375] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516383] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516391] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516398] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516405] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516413] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516421] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516428] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516435] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516443] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516451] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516458] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516465] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516473] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516480] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516491] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516499] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516506] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516514] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516521] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516529] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516538] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516546] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516564] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516571] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516579] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516586] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516611] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516618] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516626] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516634] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516642] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516651] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516659] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516667] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516674] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516683] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516691] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516698] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516707] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516715] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516723] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516731] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516739] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516746] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516754] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516762] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516771] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516779] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516787] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516795] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.684 [2024-04-24 19:21:43.516803] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516814] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516825] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516835] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516845] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.684 [2024-04-24 19:21:43.516853] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.684 [2024-04-24 19:21:43.516863] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516871] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.516879] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516887] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.516895] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516903] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.516911] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516920] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.516928] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516936] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.516944] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516951] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.516959] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516967] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.516976] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516984] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.516992] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.516999] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517007] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517026] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517037] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517047] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517056] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517066] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517076] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517086] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517096] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517106] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517117] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517127] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517137] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517147] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517157] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517167] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517177] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517187] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517197] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517207] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517217] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517227] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517237] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517247] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517259] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517269] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517278] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517288] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517298] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517308] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517319] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517329] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517338] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517348] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517359] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517368] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517378] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517388] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517397] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517409] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517422] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517432] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517443] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517453] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517463] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517473] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517483] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517493] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517503] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517513] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517522] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517532] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517542] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517559] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517570] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517580] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517590] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517600] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517610] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517619] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517630] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517640] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517650] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517659] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517669] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517681] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517691] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517701] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517711] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517721] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517730] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517740] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517750] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517760] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517772] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517781] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517792] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517802] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517812] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517822] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517832] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517842] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517852] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517869] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517883] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517893] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517908] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517921] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517931] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517946] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:56.685 [2024-04-24 19:21:43.517956] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517966] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.517980] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.517990] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.518005] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.518014] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.518028] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.518043] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.518053] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.518067] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:56.685 [2024-04-24 19:21:43.518081] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:56.685 [2024-04-24 19:21:43.518091] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:15:03.248 19:21:49 -- target/device_removal.sh@147 -- # seq 1 10 00:15:03.248 19:21:49 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:15:03.248 19:21:49 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:15:03.248 19:21:49 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:15:03.248 19:21:49 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:03.248 19:21:49 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:03.248 19:21:49 -- target/device_removal.sh@77 -- # grep mlx5_1 00:15:03.248 19:21:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.248 19:21:49 -- common/autotest_common.sh@10 -- # set +x 00:15:03.248 19:21:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.248 19:21:49 -- target/device_removal.sh@78 -- # return 1 00:15:03.248 19:21:49 -- target/device_removal.sh@149 -- # break 00:15:03.248 19:21:49 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:03.248 19:21:49 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:03.248 19:21:49 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:03.248 19:21:49 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:03.248 19:21:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.248 19:21:49 -- common/autotest_common.sh@10 -- # set +x 00:15:03.248 19:21:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.248 19:21:49 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:15:03.248 19:21:49 -- target/device_removal.sh@160 -- # rescan_pci 00:15:03.248 19:21:49 -- target/device_removal.sh@57 -- # echo 1 00:15:03.248 [2024-04-24 19:21:50.103277] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0xe94c40, err 11. Skip rescan. 00:15:03.248 19:21:50 -- target/device_removal.sh@162 -- # seq 1 10 00:15:03.248 19:21:50 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:15:03.248 19:21:50 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:15:03.248 19:21:50 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:15:03.248 19:21:50 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:15:03.248 19:21:50 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:15:03.248 19:21:50 -- target/device_removal.sh@171 -- # break 00:15:03.248 19:21:50 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:15:03.248 19:21:50 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:15:03.506 [2024-04-24 19:21:50.456369] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xe85280/0xed77e0) succeed. 00:15:03.506 [2024-04-24 19:21:50.456454] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:15:06.791 19:21:53 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:15:06.791 19:21:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:06.791 19:21:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:06.791 19:21:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:06.791 19:21:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:06.791 19:21:53 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:15:06.791 19:21:53 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:15:06.791 19:21:53 -- target/device_removal.sh@186 -- # seq 1 10 00:15:06.791 19:21:53 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:15:06.791 19:21:53 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:06.791 19:21:53 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:06.791 19:21:53 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:06.791 19:21:53 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:06.791 19:21:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:06.791 19:21:53 -- common/autotest_common.sh@10 -- # set +x 00:15:06.791 [2024-04-24 19:21:53.564655] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:15:06.791 [2024-04-24 19:21:53.564691] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:15:06.791 [2024-04-24 19:21:53.564710] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:06.791 [2024-04-24 19:21:53.564727] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:06.791 19:21:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:06.791 19:21:53 -- target/device_removal.sh@187 -- # ib_count=2 00:15:06.791 19:21:53 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:15:06.791 19:21:53 -- target/device_removal.sh@189 -- # break 00:15:06.791 19:21:53 -- target/device_removal.sh@200 -- # stop_bdevperf 00:15:06.791 19:21:53 -- target/device_removal.sh@116 -- # wait 3019826 00:16:14.567 0 00:16:14.567 19:22:58 -- target/device_removal.sh@118 -- # killprocess 3019695 00:16:14.567 19:22:58 -- common/autotest_common.sh@936 -- # '[' -z 3019695 ']' 00:16:14.567 19:22:58 -- common/autotest_common.sh@940 -- # kill -0 3019695 00:16:14.567 19:22:58 -- common/autotest_common.sh@941 -- # uname 00:16:14.567 19:22:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:14.567 19:22:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3019695 00:16:14.567 19:22:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:14.567 19:22:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:14.567 19:22:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3019695' 00:16:14.567 killing process with pid 3019695 00:16:14.567 19:22:58 -- common/autotest_common.sh@955 -- # kill 3019695 00:16:14.567 19:22:58 -- common/autotest_common.sh@960 -- # wait 3019695 00:16:14.567 19:22:58 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:16:14.567 19:22:58 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:14.567 [2024-04-24 19:21:27.155099] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:16:14.567 [2024-04-24 19:21:27.155148] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3019695 ] 00:16:14.567 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.567 [2024-04-24 19:21:27.223490] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:14.567 [2024-04-24 19:21:27.304985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:14.567 Running I/O for 90 seconds... 00:16:14.567 [2024-04-24 19:21:33.353628] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:16:14.567 [2024-04-24 19:21:33.353663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.567 [2024-04-24 19:21:33.353677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.567 [2024-04-24 19:21:33.353689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.567 [2024-04-24 19:21:33.353700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.567 [2024-04-24 19:21:33.353711] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.567 [2024-04-24 19:21:33.353723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.567 [2024-04-24 19:21:33.353733] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.567 [2024-04-24 19:21:33.353743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.567 [2024-04-24 19:21:33.355715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.567 [2024-04-24 19:21:33.355730] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.567 [2024-04-24 19:21:33.355770] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:14.567 [2024-04-24 19:21:33.362997] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.373023] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.383987] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.394013] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.404043] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.414157] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.424376] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.434401] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.444432] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.454654] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.464679] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.474849] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.484915] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.494941] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.505021] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.515437] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.525703] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.535860] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.545884] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.556046] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.566392] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.576552] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.586574] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.596682] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.607239] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.617728] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.627754] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.637789] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.648007] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.658530] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.669077] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.679104] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.689129] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.699154] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.709179] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.719357] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.729385] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.739409] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.749437] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.759463] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.769490] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.779516] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.789542] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.799570] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.809640] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.819665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.829701] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.839745] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.850069] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.860341] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.870399] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.880589] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.891031] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.901056] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.911082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.921108] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.931315] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.941343] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.951427] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.961513] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.971558] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.567 [2024-04-24 19:21:33.981632] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:33.991771] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.001833] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.011963] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.022386] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.032512] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.042540] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.052607] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.062713] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.072780] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.082958] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.093042] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.103134] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.113190] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.123281] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.133467] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.143570] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.153712] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.163987] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.174011] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.184037] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.194169] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.204210] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.214311] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.224340] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.234623] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.244862] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.255016] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.265082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.275205] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.285452] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.295717] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.305883] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.316080] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.326107] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.336132] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.346185] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.356296] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.568 [2024-04-24 19:21:34.358223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:197664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:197672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:197680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:197688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:197696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:197704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:197712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:197720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:197728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:197736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:197744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:197752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:197760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:197768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:197776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:197784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:197792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:197800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:197808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:197816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:197824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:197832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.568 [2024-04-24 19:21:34.358758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:197840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.568 [2024-04-24 19:21:34.358767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:197848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:197856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:197864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:197872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:197880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:197888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:197896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:197904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:197912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.358989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:197920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.358999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:197928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:197936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:197944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:197952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:197960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:197968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:197976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:197984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:197992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:198000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:198008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:198016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:198024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:198032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:198040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:198048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:198056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:198064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:198072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:198080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:198088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:198096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:198104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:198112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:198120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:198128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:198136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:198144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.569 [2024-04-24 19:21:34.359651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:198152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.569 [2024-04-24 19:21:34.359660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.359675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:198160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.570 [2024-04-24 19:21:34.359684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.359697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:198168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.570 [2024-04-24 19:21:34.359706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.359718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:198176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.570 [2024-04-24 19:21:34.359727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.359740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:198184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.570 [2024-04-24 19:21:34.359750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.372705] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:16:14.570 [2024-04-24 19:21:34.372776] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:14.570 [2024-04-24 19:21:34.372786] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:14.570 [2024-04-24 19:21:34.372795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:198192 len:8 PRP1 0x0 PRP2 0x0 00:16:14.570 [2024-04-24 19:21:34.372805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.372818] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:14.570 [2024-04-24 19:21:34.372825] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:14.570 [2024-04-24 19:21:34.372833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:198200 len:8 PRP1 0x0 PRP2 0x0 00:16:14.570 [2024-04-24 19:21:34.372843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:34.375977] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:34.376247] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.570 [2024-04-24 19:21:34.376263] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:34.376271] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:34.376300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:34.376312] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:34.376337] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:34.376347] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:34.376358] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:34.376379] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:34.376389] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:35.379152] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.570 [2024-04-24 19:21:35.379189] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:35.379199] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:35.379221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:35.379233] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:35.379245] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:35.379255] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:35.379266] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:35.379289] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:35.379300] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:36.382060] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.570 [2024-04-24 19:21:36.382095] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:36.382104] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:36.382126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:36.382137] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:36.382150] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:36.382159] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:36.382169] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:36.382192] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:36.382203] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:38.387620] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:38.387656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:38.387683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:38.387694] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:38.387925] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:38.387937] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:38.387947] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:38.387977] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:38.387989] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:40.393073] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:40.393101] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:40.393128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:40.393140] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:40.393153] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:40.393162] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:40.393173] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:40.393197] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:40.393209] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:42.398270] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.570 [2024-04-24 19:21:42.398305] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:14.570 [2024-04-24 19:21:42.398329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:42.398340] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:14.570 [2024-04-24 19:21:42.398353] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:14.570 [2024-04-24 19:21:42.398363] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:14.570 [2024-04-24 19:21:42.398374] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:14.570 [2024-04-24 19:21:42.398397] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.570 [2024-04-24 19:21:42.398409] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:14.570 [2024-04-24 19:21:43.450650] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:14.570 [2024-04-24 19:21:43.514350] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:14.570 [2024-04-24 19:21:43.514376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.570 [2024-04-24 19:21:43.514389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:43.514400] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.570 [2024-04-24 19:21:43.514409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:43.514420] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.570 [2024-04-24 19:21:43.514429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:43.514439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:14.570 [2024-04-24 19:21:43.514448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32729 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:14.570 [2024-04-24 19:21:43.516085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.570 [2024-04-24 19:21:43.516099] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.570 [2024-04-24 19:21:43.516124] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:14.571 [2024-04-24 19:21:43.524358] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.534381] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.544408] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.554434] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.564459] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.574483] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.584509] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.594534] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.604562] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.614590] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.624615] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.634641] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.644668] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.654696] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.664720] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.674746] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.684772] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.694800] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.704827] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.714855] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.724882] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.734907] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.744932] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.754958] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.764985] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.775010] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.785035] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.795061] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.805086] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.815111] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.825136] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.835164] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.845189] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.855216] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.865242] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.875269] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.885293] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.895320] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.905346] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.915372] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.925399] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.935427] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.945451] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.955478] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.965502] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.975526] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.985556] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:43.995578] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.005603] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.015629] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.025655] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.035682] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.045709] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.055737] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.065761] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.075786] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.085815] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.095842] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.105871] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.115899] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.125927] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.135954] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.145983] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.156009] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.166040] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.176067] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.186093] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.196118] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.206150] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.216176] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.226207] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.236233] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.246261] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.571 [2024-04-24 19:21:44.256286] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.266316] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.276342] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.286372] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.296396] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.306428] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.316455] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.326487] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.336514] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.346544] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.356570] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.366597] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.376623] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.386649] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.396676] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.406704] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.417734] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.428121] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.438468] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.449684] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.459711] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.470431] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.480488] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.490822] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.501699] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.511718] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:14.572 [2024-04-24 19:21:44.518572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:21952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:21960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:21968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:21976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:21984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:22000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:22008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:22016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:22032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:22040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:22048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:22056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:22064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:22080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:22088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:22096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:22104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.518987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.518997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:22112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:22128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:22136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:22144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:22160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.572 [2024-04-24 19:21:44.519137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:22168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.572 [2024-04-24 19:21:44.519146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:22184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:22192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:22208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:22224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:22232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:22240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:22256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:22264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:22272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:22280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:22288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:22296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:22304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:22312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:22320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:22328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:22352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:22360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:22368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:22376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:22400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:22408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:22416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:22424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:22432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:22440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:22448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.573 [2024-04-24 19:21:44.519853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.573 [2024-04-24 19:21:44.519864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:22456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:22472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:22480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:22488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:22496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.519988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.519997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:22512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.520017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:22520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:14.574 [2024-04-24 19:21:44.520037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:21504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:21512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f8000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:21536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f6000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:21544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f4000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:21552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f2000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f0000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:21568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ee000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ec000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ea000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:21592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e8000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e6000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:21608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:21632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:21640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:21648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:21664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:21680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:21704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.574 [2024-04-24 19:21:44.520601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0x1beb00 00:16:14.574 [2024-04-24 19:21:44.520610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:21736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:21744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c2000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:21752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c0000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079be000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079bc000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:21784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:21808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:21816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:21832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:21840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.520984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.520994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:21864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:21872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:21880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:21888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:21896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:21904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:21912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:21920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:21928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.521210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:21936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0x1beb00 00:16:14.575 [2024-04-24 19:21:44.521221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32729 cdw0:a85247d0 sqhd:4530 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.534872] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:14.575 [2024-04-24 19:21:44.534886] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:14.575 [2024-04-24 19:21:44.534895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21944 len:8 PRP1 0x0 PRP2 0x0 00:16:14.575 [2024-04-24 19:21:44.534905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:14.575 [2024-04-24 19:21:44.534954] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.575 [2024-04-24 19:21:44.538027] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.575 [2024-04-24 19:21:44.538047] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.575 [2024-04-24 19:21:44.538055] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.575 [2024-04-24 19:21:44.538074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.575 [2024-04-24 19:21:44.538084] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.575 [2024-04-24 19:21:44.538119] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.575 [2024-04-24 19:21:44.538128] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.575 [2024-04-24 19:21:44.538139] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.575 [2024-04-24 19:21:44.538160] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.575 [2024-04-24 19:21:44.538170] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:45.541017] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.576 [2024-04-24 19:21:45.541054] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:45.541064] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:45.541087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:45.541099] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:45.541111] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:45.541121] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:45.541132] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:45.541171] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:45.541185] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:46.544279] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:14.576 [2024-04-24 19:21:46.544314] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:46.544323] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:46.544346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:46.544357] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:46.544385] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:46.544394] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:46.544405] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:46.544429] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:46.544440] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:48.550434] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:48.550472] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:48.550501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:48.550512] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:48.551308] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:48.551322] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:48.551333] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:48.551522] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:48.551535] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:50.559203] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:50.559236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:50.559265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:50.559277] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:50.559290] bdev_nvme.c:2871:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:16:14.576 [2024-04-24 19:21:50.559322] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:50.559333] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:50.559343] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:50.559385] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:50.559425] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:51.561905] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:51.561942] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:51.561969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:51.561980] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:51.562331] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:51.562343] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:51.562353] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:51.562379] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:51.562390] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:53.568032] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:14.576 [2024-04-24 19:21:53.568061] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:14.576 [2024-04-24 19:21:53.568091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:14.576 [2024-04-24 19:21:53.568103] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:14.576 [2024-04-24 19:21:53.568506] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:14.576 [2024-04-24 19:21:53.568520] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:14.576 [2024-04-24 19:21:53.568532] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:14.576 [2024-04-24 19:21:53.568584] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:14.576 [2024-04-24 19:21:53.568597] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:14.576 [2024-04-24 19:21:54.621975] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:14.576 00:16:14.576 Latency(us) 00:16:14.576 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.576 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:14.576 Verification LBA range: start 0x0 length 0x8000 00:16:14.576 Nvme_mlx_0_0n1 : 90.01 11186.32 43.70 0.00 0.00 11419.31 1980.33 11087551.44 00:16:14.576 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:14.576 Verification LBA range: start 0x0 length 0x8000 00:16:14.576 Nvme_mlx_0_1n1 : 90.01 9650.36 37.70 0.00 0.00 13244.23 2421.98 12079595.52 00:16:14.576 =================================================================================================================== 00:16:14.576 Total : 20836.68 81.39 0.00 0.00 12264.51 1980.33 12079595.52 00:16:14.576 Received shutdown signal, test time was about 90.000000 seconds 00:16:14.576 00:16:14.576 Latency(us) 00:16:14.576 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.576 =================================================================================================================== 00:16:14.576 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:14.576 19:22:58 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:16:14.576 19:22:58 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:14.576 19:22:58 -- target/device_removal.sh@202 -- # killprocess 3019571 00:16:14.576 19:22:58 -- common/autotest_common.sh@936 -- # '[' -z 3019571 ']' 00:16:14.576 19:22:58 -- common/autotest_common.sh@940 -- # kill -0 3019571 00:16:14.576 19:22:58 -- common/autotest_common.sh@941 -- # uname 00:16:14.576 19:22:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:14.576 19:22:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3019571 00:16:14.576 19:22:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:14.577 19:22:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:14.577 19:22:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3019571' 00:16:14.577 killing process with pid 3019571 00:16:14.577 19:22:58 -- common/autotest_common.sh@955 -- # kill 3019571 00:16:14.577 19:22:58 -- common/autotest_common.sh@960 -- # wait 3019571 00:16:14.577 [2024-04-24 19:22:58.946849] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:14.577 19:22:59 -- target/device_removal.sh@203 -- # nvmfpid= 00:16:14.577 19:22:59 -- target/device_removal.sh@205 -- # return 0 00:16:14.577 00:16:14.577 real 1m33.317s 00:16:14.577 user 4m25.557s 00:16:14.577 sys 0m4.527s 00:16:14.577 19:22:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:14.577 19:22:59 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 ************************************ 00:16:14.577 END TEST nvmf_device_removal_pci_remove_no_srq 00:16:14.577 ************************************ 00:16:14.577 19:22:59 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:16:14.577 19:22:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:14.577 19:22:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:14.577 19:22:59 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 ************************************ 00:16:14.577 START TEST nvmf_device_removal_pci_remove 00:16:14.577 ************************************ 00:16:14.577 19:22:59 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:16:14.577 19:22:59 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:16:14.577 19:22:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:14.577 19:22:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:14.577 19:22:59 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 19:22:59 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:14.577 19:22:59 -- nvmf/common.sh@470 -- # nvmfpid=3032037 00:16:14.577 19:22:59 -- nvmf/common.sh@471 -- # waitforlisten 3032037 00:16:14.577 19:22:59 -- common/autotest_common.sh@817 -- # '[' -z 3032037 ']' 00:16:14.577 19:22:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:14.577 19:22:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:14.577 19:22:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:14.577 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:14.577 19:22:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:14.577 19:22:59 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 [2024-04-24 19:22:59.497496] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:16:14.577 [2024-04-24 19:22:59.497556] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:14.577 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.577 [2024-04-24 19:22:59.570034] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:14.577 [2024-04-24 19:22:59.657848] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:14.577 [2024-04-24 19:22:59.657885] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:14.577 [2024-04-24 19:22:59.657895] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:14.577 [2024-04-24 19:22:59.657904] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:14.577 [2024-04-24 19:22:59.657912] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:14.577 [2024-04-24 19:22:59.657973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:14.577 [2024-04-24 19:22:59.657975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:14.577 19:23:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:14.577 19:23:00 -- common/autotest_common.sh@850 -- # return 0 00:16:14.577 19:23:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:14.577 19:23:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 19:23:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:14.577 19:23:00 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:16:14.577 19:23:00 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:16:14.577 19:23:00 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:16:14.577 19:23:00 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:14.577 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 [2024-04-24 19:23:00.389396] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x98cc60/0x991150) succeed. 00:16:14.577 [2024-04-24 19:23:00.398787] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x98e160/0x9d27e0) succeed. 00:16:14.577 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.577 19:23:00 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:16:14.577 19:23:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:14.577 19:23:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:14.577 19:23:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:14.577 19:23:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:14.577 19:23:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:14.577 19:23:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:14.577 19:23:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:14.577 19:23:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:14.577 19:23:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:14.577 19:23:00 -- nvmf/common.sh@105 -- # continue 2 00:16:14.577 19:23:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:14.577 19:23:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:14.577 19:23:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:14.577 19:23:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:14.577 19:23:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:14.577 19:23:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:14.577 19:23:00 -- nvmf/common.sh@105 -- # continue 2 00:16:14.577 19:23:00 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:14.577 19:23:00 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:14.577 19:23:00 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:16:14.577 19:23:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:14.577 19:23:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:14.577 19:23:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:14.577 19:23:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:14.577 19:23:00 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:16:14.577 19:23:00 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:14.577 19:23:00 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:14.577 19:23:00 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:16:14.577 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.577 19:23:00 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:16:14.577 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.577 19:23:00 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:16:14.577 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.577 19:23:00 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:16:14.577 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.577 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.577 [2024-04-24 19:23:00.603142] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:14.577 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.577 19:23:00 -- target/device_removal.sh@41 -- # return 0 00:16:14.577 19:23:00 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:16:14.577 19:23:00 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:14.577 19:23:00 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:16:14.577 19:23:00 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:14.577 19:23:00 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:16:14.578 19:23:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:14.578 19:23:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:14.578 19:23:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:14.578 19:23:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:14.578 19:23:00 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:16:14.578 19:23:00 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:14.578 19:23:00 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:14.578 19:23:00 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:16:14.578 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.578 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.578 19:23:00 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:16:14.578 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.578 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.578 19:23:00 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:16:14.578 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.578 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.578 19:23:00 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:16:14.578 19:23:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.578 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 [2024-04-24 19:23:00.687231] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:14.578 19:23:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.578 19:23:00 -- target/device_removal.sh@41 -- # return 0 00:16:14.578 19:23:00 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@53 -- # return 0 00:16:14.578 19:23:00 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:16:14.578 19:23:00 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:16:14.578 19:23:00 -- target/device_removal.sh@87 -- # local dev_names 00:16:14.578 19:23:00 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:14.578 19:23:00 -- target/device_removal.sh@91 -- # bdevperf_pid=3032258 00:16:14.578 19:23:00 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:14.578 19:23:00 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:16:14.578 19:23:00 -- target/device_removal.sh@94 -- # waitforlisten 3032258 /var/tmp/bdevperf.sock 00:16:14.578 19:23:00 -- common/autotest_common.sh@817 -- # '[' -z 3032258 ']' 00:16:14.578 19:23:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:14.578 19:23:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:14.578 19:23:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:14.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:14.578 19:23:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:14.578 19:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 19:23:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:14.578 19:23:01 -- common/autotest_common.sh@850 -- # return 0 00:16:14.578 19:23:01 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:16:14.578 19:23:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.578 19:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:14.578 19:23:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.578 19:23:01 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:14.578 19:23:01 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:16:14.578 19:23:01 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:14.578 19:23:01 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:14.578 19:23:01 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:16:14.578 19:23:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:14.578 19:23:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:14.578 19:23:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:14.578 19:23:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:14.836 19:23:01 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:16:14.836 19:23:01 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:16:14.837 19:23:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.837 19:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:14.837 Nvme_mlx_0_0n1 00:16:14.837 19:23:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.837 19:23:01 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:14.837 19:23:01 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:16:14.837 19:23:01 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:14.837 19:23:01 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:14.837 19:23:01 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:16:14.837 19:23:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:14.837 19:23:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:14.837 19:23:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:14.837 19:23:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:14.837 19:23:01 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:16:14.837 19:23:01 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:16:14.837 19:23:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.837 19:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:14.837 Nvme_mlx_0_1n1 00:16:14.837 19:23:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.837 19:23:01 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3032372 00:16:14.837 19:23:01 -- target/device_removal.sh@112 -- # sleep 5 00:16:14.837 19:23:01 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:16:20.111 19:23:06 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:20.111 19:23:06 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:20.111 19:23:06 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:16:20.111 19:23:06 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:16:20.111 19:23:06 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:16:20.111 19:23:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:20.111 19:23:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:20.111 19:23:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:20.111 19:23:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:20.111 19:23:06 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:16:20.111 19:23:06 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:20.111 19:23:06 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:16:20.111 19:23:06 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:20.111 19:23:06 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:20.111 19:23:06 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:20.111 19:23:06 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:20.111 19:23:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:20.111 19:23:06 -- common/autotest_common.sh@10 -- # set +x 00:16:20.111 19:23:06 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:20.111 19:23:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:20.111 mlx5_0 00:16:20.111 19:23:06 -- target/device_removal.sh@78 -- # return 0 00:16:20.111 19:23:06 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:16:20.111 19:23:06 -- target/device_removal.sh@67 -- # echo 1 00:16:20.112 19:23:06 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:16:20.112 19:23:06 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:20.112 19:23:06 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:20.112 [2024-04-24 19:23:06.926127] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:16:20.112 [2024-04-24 19:23:06.926236] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:20.112 [2024-04-24 19:23:06.934772] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:20.112 [2024-04-24 19:23:06.934806] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 34 00:16:26.678 19:23:12 -- target/device_removal.sh@147 -- # seq 1 10 00:16:26.678 19:23:12 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:26.678 19:23:12 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:26.678 19:23:12 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:26.678 19:23:12 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:26.678 19:23:12 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:26.678 19:23:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:26.678 19:23:12 -- common/autotest_common.sh@10 -- # set +x 00:16:26.678 19:23:12 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:26.678 19:23:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:26.678 19:23:12 -- target/device_removal.sh@78 -- # return 1 00:16:26.678 19:23:12 -- target/device_removal.sh@149 -- # break 00:16:26.678 19:23:12 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:26.678 19:23:12 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:26.678 19:23:12 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:26.678 19:23:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:26.678 19:23:12 -- common/autotest_common.sh@10 -- # set +x 00:16:26.678 19:23:12 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:26.678 19:23:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:26.678 19:23:12 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:26.678 19:23:12 -- target/device_removal.sh@160 -- # rescan_pci 00:16:26.678 19:23:12 -- target/device_removal.sh@57 -- # echo 1 00:16:26.678 [2024-04-24 19:23:13.529641] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0xa6b1e0, err 11. Skip rescan. 00:16:26.678 19:23:13 -- target/device_removal.sh@162 -- # seq 1 10 00:16:26.678 19:23:13 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:26.678 19:23:13 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:16:26.678 19:23:13 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:16:26.678 19:23:13 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:16:26.678 19:23:13 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:16:26.678 19:23:13 -- target/device_removal.sh@171 -- # break 00:16:26.678 19:23:13 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:16:26.678 19:23:13 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:16:26.936 [2024-04-24 19:23:13.913139] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x98f8f0/0x991150) succeed. 00:16:26.936 [2024-04-24 19:23:13.913201] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:16:30.224 19:23:16 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:16:30.224 19:23:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:30.224 19:23:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:30.224 19:23:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:30.224 19:23:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:30.224 19:23:16 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:30.224 19:23:16 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:16:30.224 19:23:16 -- target/device_removal.sh@186 -- # seq 1 10 00:16:30.224 19:23:16 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:30.224 19:23:16 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:30.225 19:23:16 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:30.225 19:23:16 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:30.225 19:23:16 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:30.225 19:23:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.225 19:23:16 -- common/autotest_common.sh@10 -- # set +x 00:16:30.225 [2024-04-24 19:23:16.918252] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:30.225 [2024-04-24 19:23:16.918282] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:16:30.225 [2024-04-24 19:23:16.918298] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:30.225 [2024-04-24 19:23:16.918312] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:30.225 19:23:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.225 19:23:16 -- target/device_removal.sh@187 -- # ib_count=2 00:16:30.225 19:23:16 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:30.225 19:23:16 -- target/device_removal.sh@189 -- # break 00:16:30.225 19:23:16 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:30.225 19:23:16 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:30.225 19:23:16 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:16:30.225 19:23:16 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:16:30.225 19:23:16 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:16:30.225 19:23:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:30.225 19:23:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:30.225 19:23:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:30.225 19:23:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:30.225 19:23:16 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:16:30.225 19:23:16 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:30.225 19:23:16 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:30.225 19:23:17 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:16:30.225 19:23:17 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:30.225 19:23:17 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:30.225 19:23:17 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:30.225 19:23:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.225 19:23:17 -- common/autotest_common.sh@10 -- # set +x 00:16:30.225 19:23:17 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:30.225 19:23:17 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:30.225 19:23:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.225 mlx5_1 00:16:30.225 19:23:17 -- target/device_removal.sh@78 -- # return 0 00:16:30.225 19:23:17 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:16:30.225 19:23:17 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:16:30.225 19:23:17 -- target/device_removal.sh@67 -- # echo 1 00:16:30.225 19:23:17 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:16:30.225 19:23:17 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:30.225 19:23:17 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:30.225 [2024-04-24 19:23:17.103282] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:16:30.225 [2024-04-24 19:23:17.103359] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:30.225 [2024-04-24 19:23:17.111527] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:30.225 [2024-04-24 19:23:17.111555] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 2 00:16:36.789 19:23:22 -- target/device_removal.sh@147 -- # seq 1 10 00:16:36.789 19:23:22 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:36.789 19:23:22 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:36.789 19:23:22 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:36.789 19:23:22 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:36.789 19:23:22 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:36.789 19:23:22 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:36.789 19:23:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:36.789 19:23:22 -- common/autotest_common.sh@10 -- # set +x 00:16:36.789 19:23:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:36.789 19:23:22 -- target/device_removal.sh@78 -- # return 1 00:16:36.789 19:23:22 -- target/device_removal.sh@149 -- # break 00:16:36.789 19:23:22 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:36.789 19:23:22 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:36.789 19:23:22 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:36.789 19:23:22 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:36.789 19:23:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:36.789 19:23:22 -- common/autotest_common.sh@10 -- # set +x 00:16:36.789 19:23:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:36.789 19:23:22 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:36.789 19:23:22 -- target/device_removal.sh@160 -- # rescan_pci 00:16:36.789 19:23:22 -- target/device_removal.sh@57 -- # echo 1 00:16:37.048 [2024-04-24 19:23:23.824275] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x9787e0, err 11. Skip rescan. 00:16:37.048 19:23:23 -- target/device_removal.sh@162 -- # seq 1 10 00:16:37.048 19:23:23 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:37.048 19:23:23 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:16:37.048 19:23:23 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:16:37.048 19:23:23 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:16:37.048 19:23:23 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:16:37.048 19:23:23 -- target/device_removal.sh@171 -- # break 00:16:37.048 19:23:23 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:16:37.048 19:23:23 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:16:37.307 [2024-04-24 19:23:24.217220] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x98ff70/0x9d27e0) succeed. 00:16:37.307 [2024-04-24 19:23:24.217305] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:16:40.599 19:23:27 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:16:40.599 19:23:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:40.599 19:23:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:40.599 19:23:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:40.599 19:23:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:40.599 19:23:27 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:40.599 19:23:27 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:16:40.599 19:23:27 -- target/device_removal.sh@186 -- # seq 1 10 00:16:40.599 19:23:27 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:40.599 19:23:27 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:40.599 19:23:27 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:40.599 19:23:27 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:40.599 19:23:27 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:40.599 19:23:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:40.599 19:23:27 -- common/autotest_common.sh@10 -- # set +x 00:16:40.599 [2024-04-24 19:23:27.290904] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:40.599 [2024-04-24 19:23:27.290944] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:16:40.599 [2024-04-24 19:23:27.290963] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:40.599 [2024-04-24 19:23:27.290980] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:40.599 19:23:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:40.599 19:23:27 -- target/device_removal.sh@187 -- # ib_count=2 00:16:40.599 19:23:27 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:40.599 19:23:27 -- target/device_removal.sh@189 -- # break 00:16:40.599 19:23:27 -- target/device_removal.sh@200 -- # stop_bdevperf 00:16:40.599 19:23:27 -- target/device_removal.sh@116 -- # wait 3032372 00:17:48.300 0 00:17:48.300 19:24:32 -- target/device_removal.sh@118 -- # killprocess 3032258 00:17:48.300 19:24:32 -- common/autotest_common.sh@936 -- # '[' -z 3032258 ']' 00:17:48.300 19:24:32 -- common/autotest_common.sh@940 -- # kill -0 3032258 00:17:48.300 19:24:32 -- common/autotest_common.sh@941 -- # uname 00:17:48.300 19:24:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:48.300 19:24:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3032258 00:17:48.300 19:24:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:48.300 19:24:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:48.300 19:24:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3032258' 00:17:48.300 killing process with pid 3032258 00:17:48.300 19:24:32 -- common/autotest_common.sh@955 -- # kill 3032258 00:17:48.300 19:24:32 -- common/autotest_common.sh@960 -- # wait 3032258 00:17:48.300 19:24:32 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:17:48.300 19:24:32 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:48.300 [2024-04-24 19:23:00.745198] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:17:48.300 [2024-04-24 19:23:00.745248] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3032258 ] 00:17:48.300 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.300 [2024-04-24 19:23:00.812528] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.300 [2024-04-24 19:23:00.893360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:48.300 Running I/O for 90 seconds... 00:17:48.300 [2024-04-24 19:23:06.926962] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:48.300 [2024-04-24 19:23:06.927004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.300 [2024-04-24 19:23:06.927017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.300 [2024-04-24 19:23:06.927030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.300 [2024-04-24 19:23:06.927040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.300 [2024-04-24 19:23:06.927051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.300 [2024-04-24 19:23:06.927061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.300 [2024-04-24 19:23:06.927071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.300 [2024-04-24 19:23:06.927081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.300 [2024-04-24 19:23:06.928745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.300 [2024-04-24 19:23:06.928763] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.300 [2024-04-24 19:23:06.928792] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:48.300 [2024-04-24 19:23:06.936959] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.946981] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.957007] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.967037] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.977064] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.987409] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:06.997437] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.007462] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.017487] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.027512] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.037738] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.047985] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.058222] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.068458] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.078681] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.089003] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.099338] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.109592] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.119791] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.130107] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.140387] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.150594] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.160823] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.171113] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.181417] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.191688] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.201904] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.212197] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.222488] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.232798] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.243073] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.253287] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.263539] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.273806] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.284100] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.294345] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.304549] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.314830] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.325041] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.335291] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.345574] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.355867] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.366092] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.376369] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.300 [2024-04-24 19:23:07.386627] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.396892] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.407168] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.417420] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.427692] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.438017] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.448302] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.458475] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.468689] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.478923] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.489244] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.499509] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.509733] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.519950] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.530164] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.540433] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.550665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.560979] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.571229] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.581254] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.591356] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.601613] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.611823] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.622067] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.632275] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.642504] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.652747] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.663101] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.673382] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.683770] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.694114] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.704627] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.714859] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.725218] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.735492] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.745755] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.756215] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.766311] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.776563] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.786884] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.797110] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.807477] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.817697] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.827863] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.838146] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.848384] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.858633] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.868853] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.879060] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.889278] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.899503] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.909752] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.920022] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.930293] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.301 [2024-04-24 19:23:07.931242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:206336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:206344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:206352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:206360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:206368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:206376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:206384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:206392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:206400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:206408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:206416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:206424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.301 [2024-04-24 19:23:07.931507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:206432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.301 [2024-04-24 19:23:07.931516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:206440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:206448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:206456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:206464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:206472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:206480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:206488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:206496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:206504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:206512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:206520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:206528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:206536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:206544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:206552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:206560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:206568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:206576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:206584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:206592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:206600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:206608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.931983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:206616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.931992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:206624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:206632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:206640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:206648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:206656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:206664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:206672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:206680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:206688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:206696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:206704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:206712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:206720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:206728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:206736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.302 [2024-04-24 19:23:07.932310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:206744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.302 [2024-04-24 19:23:07.932320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:206752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:206760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:206768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:206776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:206784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:206792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:206800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:206808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:206816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:206824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:206832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:206840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.303 [2024-04-24 19:23:07.932566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:205824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:205832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:205840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:205848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:205856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:205864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:205872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:205880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:205888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:205896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:205904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:205912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:205920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:205928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:205936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:205944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:205952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:205960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:205968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:205976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.932981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.932992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:205984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.933001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.933014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:205992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.933024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.303 [2024-04-24 19:23:07.933035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:206000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x1810ef 00:17:48.303 [2024-04-24 19:23:07.933045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:206008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:206016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:206024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:206032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:206040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:206048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:206056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:206064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:206072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:206080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:206088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:206096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:206104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:206112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:206120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:206128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:206136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:206144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:206152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:206160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:206168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:206176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:206184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:206192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:206200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:206208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:206216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:206224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.304 [2024-04-24 19:23:07.933641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:206232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x1810ef 00:17:48.304 [2024-04-24 19:23:07.933650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:206240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:206248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:206256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:206264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:206272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:206280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:206288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:206296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:206304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:206312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.933867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:206320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0x1810ef 00:17:48.305 [2024-04-24 19:23:07.933876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.946833] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:17:48.305 [2024-04-24 19:23:07.946907] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:48.305 [2024-04-24 19:23:07.946916] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:48.305 [2024-04-24 19:23:07.946926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:206328 len:8 PRP1 0x0 PRP2 0x0 00:17:48.305 [2024-04-24 19:23:07.946937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.305 [2024-04-24 19:23:07.949150] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:07.949439] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.305 [2024-04-24 19:23:07.949458] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:07.949466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:07.949487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:07.949497] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:07.949509] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:07.949519] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:07.949529] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:07.949556] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:07.949567] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:08.952683] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.305 [2024-04-24 19:23:08.952720] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:08.952729] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:08.952750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:08.952761] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:08.952797] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:08.952808] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:08.952819] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:08.952843] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:08.952853] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:09.958205] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.305 [2024-04-24 19:23:09.958243] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:09.958252] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:09.958274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:09.958286] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:09.958305] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:09.958315] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:09.958326] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:09.958348] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:09.958359] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:11.964397] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:11.964436] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:11.964463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:11.964475] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:11.965310] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:11.965332] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:11.965343] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:11.965370] bdev_nvme.c:2871:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:17:48.305 [2024-04-24 19:23:11.966030] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:11.966070] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:12.968891] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:12.968925] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:12.968952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:12.968964] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:12.969343] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:12.969354] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:12.969365] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:12.969390] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:12.969402] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.305 [2024-04-24 19:23:14.974334] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.305 [2024-04-24 19:23:14.974368] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.305 [2024-04-24 19:23:14.974393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.305 [2024-04-24 19:23:14.974405] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.305 [2024-04-24 19:23:14.974418] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.305 [2024-04-24 19:23:14.974428] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.305 [2024-04-24 19:23:14.974439] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.305 [2024-04-24 19:23:14.974463] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.305 [2024-04-24 19:23:14.974474] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.306 [2024-04-24 19:23:16.979397] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.306 [2024-04-24 19:23:16.979426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:48.306 [2024-04-24 19:23:16.979458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.306 [2024-04-24 19:23:16.979470] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:48.306 [2024-04-24 19:23:16.979483] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:48.306 [2024-04-24 19:23:16.979492] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:48.306 [2024-04-24 19:23:16.979503] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:48.306 [2024-04-24 19:23:16.979526] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.306 [2024-04-24 19:23:16.979536] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:48.306 [2024-04-24 19:23:17.106824] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:48.306 [2024-04-24 19:23:17.106853] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.306 [2024-04-24 19:23:17.106866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.306 [2024-04-24 19:23:17.106877] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.306 [2024-04-24 19:23:17.106886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.306 [2024-04-24 19:23:17.106898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.306 [2024-04-24 19:23:17.106908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.306 [2024-04-24 19:23:17.106919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:48.306 [2024-04-24 19:23:17.106928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32556 cdw0:16 sqhd:d3b9 p:0 m:0 dnr:0 00:17:48.306 [2024-04-24 19:23:17.116209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.306 [2024-04-24 19:23:17.116236] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.306 [2024-04-24 19:23:17.116274] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:48.306 [2024-04-24 19:23:17.116829] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.126852] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.136879] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.146906] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.156933] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.166960] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.176987] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.187012] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.197038] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.207063] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.217089] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.227115] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.237140] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.247166] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.257194] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.267219] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.277245] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.287272] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.297297] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.307323] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.317349] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.327376] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.337401] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.347426] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.357452] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.367478] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.377504] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.387530] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.397556] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.407584] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.417610] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.427638] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.437664] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.447690] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.457714] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.467741] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.477765] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.487792] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.497816] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.507841] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.517869] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.527894] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.537919] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.547947] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.557972] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.567999] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.578025] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.588051] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.598077] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.608102] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.618128] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.628155] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.638182] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.648209] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.658234] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.668259] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.678286] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.688313] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.698340] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.708365] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.718392] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.728417] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.738442] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.748469] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.758495] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.768522] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.778547] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.788574] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.306 [2024-04-24 19:23:17.798600] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.808626] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.818653] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.828678] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.838705] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.848731] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.858756] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.868782] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.878807] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.888833] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.898859] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.908884] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.918909] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.928935] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.938960] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.948985] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.959010] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.969035] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.979062] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:17.989093] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.010991] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.020979] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.025923] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:48.307 [2024-04-24 19:23:18.031004] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.041029] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.051055] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.061081] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.071106] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.081133] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.091159] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.101186] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.111210] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:48.307 [2024-04-24 19:23:18.118724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x1bf0ef 00:17:48.307 [2024-04-24 19:23:18.118739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:33776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x1bf0ef 00:17:48.307 [2024-04-24 19:23:18.118767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x1bf0ef 00:17:48.307 [2024-04-24 19:23:18.118788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:33792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:33808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:33816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:33824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:33832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:33848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.118987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.118997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:33888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:33896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:33904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:33920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:33928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:33936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:33944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.307 [2024-04-24 19:23:18.119249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.307 [2024-04-24 19:23:18.119261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:33984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:33992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:34000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:34008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:34048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:34064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:34072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:34088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:34096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:34112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:34120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:34136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:34152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:34168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:34176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:34184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:34208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:34232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.119981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.119992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:34240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.120002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.120015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:34248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.120024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.120036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:34256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.120045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.120057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:34264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.120066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.120078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:34272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.308 [2024-04-24 19:23:18.120088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.308 [2024-04-24 19:23:18.120099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:34280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:34288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:34304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:34328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:34344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:34352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:34368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:34376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:34384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:34400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:34408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:34416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:34440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:34448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:34456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:34472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:34480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.309 [2024-04-24 19:23:18.120719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.309 [2024-04-24 19:23:18.120728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:34520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:34552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:34560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:34568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:34576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:34600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:34608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.120982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.120993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:34616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:34624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:34632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:34640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:34656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:34664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:34672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:34680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:34688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:34696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:34720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:34728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:34736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:34744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:34752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:34760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:34768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.121415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:34776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:48.310 [2024-04-24 19:23:18.121424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32556 cdw0:c3e76a70 sqhd:a530 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.134426] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:48.310 [2024-04-24 19:23:18.134443] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:48.310 [2024-04-24 19:23:18.134453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34784 len:8 PRP1 0x0 PRP2 0x0 00:17:48.310 [2024-04-24 19:23:18.134464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:48.310 [2024-04-24 19:23:18.134515] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.310 [2024-04-24 19:23:18.134746] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.310 [2024-04-24 19:23:18.134759] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.310 [2024-04-24 19:23:18.134768] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.310 [2024-04-24 19:23:18.134786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.310 [2024-04-24 19:23:18.134796] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.310 [2024-04-24 19:23:18.134808] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.310 [2024-04-24 19:23:18.134819] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.310 [2024-04-24 19:23:18.134829] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:18.134848] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:18.134858] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:19.139075] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.311 [2024-04-24 19:23:19.139112] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:19.139121] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:19.139144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:19.139155] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:19.139176] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:19.139186] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:19.139196] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:19.139219] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:19.139229] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:20.143154] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:48.311 [2024-04-24 19:23:20.143195] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:20.143204] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:20.143228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:20.143239] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:20.143260] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:20.143270] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:20.143281] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:20.143304] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:20.143316] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:22.148248] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:22.148289] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:22.148317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:22.148328] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:22.148342] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:22.148351] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:22.148362] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:22.148386] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:22.148397] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:24.154500] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:24.154538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:24.154572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:24.154585] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:24.154625] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:24.154636] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:24.154647] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:24.154711] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:24.154723] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:26.161846] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:26.161886] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:26.161914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:26.161925] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:26.163418] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:26.163435] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:26.163447] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:26.163499] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:26.163511] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:28.171938] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:48.311 [2024-04-24 19:23:28.171984] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:48.311 [2024-04-24 19:23:28.172032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:48.311 [2024-04-24 19:23:28.172043] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:48.311 [2024-04-24 19:23:28.172814] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:48.311 [2024-04-24 19:23:28.172828] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:48.311 [2024-04-24 19:23:28.172839] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:48.311 [2024-04-24 19:23:28.173166] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:48.311 [2024-04-24 19:23:28.173181] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:48.311 [2024-04-24 19:23:29.230135] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:48.311 00:17:48.311 Latency(us) 00:17:48.311 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.311 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:48.311 Verification LBA range: start 0x0 length 0x8000 00:17:48.311 Nvme_mlx_0_0n1 : 90.01 11010.55 43.01 0.00 0.00 11607.72 2008.82 12079595.52 00:17:48.311 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:48.311 Verification LBA range: start 0x0 length 0x8000 00:17:48.311 Nvme_mlx_0_1n1 : 90.01 9486.55 37.06 0.00 0.00 13471.49 2393.49 13071639.60 00:17:48.311 =================================================================================================================== 00:17:48.311 Total : 20497.10 80.07 0.00 0.00 12470.31 2008.82 13071639.60 00:17:48.311 Received shutdown signal, test time was about 90.000000 seconds 00:17:48.311 00:17:48.311 Latency(us) 00:17:48.311 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.311 =================================================================================================================== 00:17:48.311 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:48.311 19:24:32 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:17:48.311 19:24:32 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:48.311 19:24:32 -- target/device_removal.sh@202 -- # killprocess 3032037 00:17:48.311 19:24:32 -- common/autotest_common.sh@936 -- # '[' -z 3032037 ']' 00:17:48.311 19:24:32 -- common/autotest_common.sh@940 -- # kill -0 3032037 00:17:48.311 19:24:32 -- common/autotest_common.sh@941 -- # uname 00:17:48.311 19:24:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:48.311 19:24:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3032037 00:17:48.311 19:24:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:48.311 19:24:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:48.311 19:24:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3032037' 00:17:48.311 killing process with pid 3032037 00:17:48.311 19:24:32 -- common/autotest_common.sh@955 -- # kill 3032037 00:17:48.311 19:24:32 -- common/autotest_common.sh@960 -- # wait 3032037 00:17:48.311 [2024-04-24 19:24:32.551396] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:48.311 19:24:32 -- target/device_removal.sh@203 -- # nvmfpid= 00:17:48.311 19:24:32 -- target/device_removal.sh@205 -- # return 0 00:17:48.311 00:17:48.311 real 1m33.414s 00:17:48.311 user 4m25.615s 00:17:48.311 sys 0m4.707s 00:17:48.311 19:24:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:48.311 19:24:32 -- common/autotest_common.sh@10 -- # set +x 00:17:48.311 ************************************ 00:17:48.312 END TEST nvmf_device_removal_pci_remove 00:17:48.312 ************************************ 00:17:48.312 19:24:32 -- target/device_removal.sh@317 -- # nvmftestfini 00:17:48.312 19:24:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:48.312 19:24:32 -- nvmf/common.sh@117 -- # sync 00:17:48.312 19:24:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:48.312 19:24:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:48.312 19:24:32 -- nvmf/common.sh@120 -- # set +e 00:17:48.312 19:24:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:48.312 19:24:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:48.312 rmmod nvme_rdma 00:17:48.312 rmmod nvme_fabrics 00:17:48.312 19:24:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:48.312 19:24:32 -- nvmf/common.sh@124 -- # set -e 00:17:48.312 19:24:32 -- nvmf/common.sh@125 -- # return 0 00:17:48.312 19:24:32 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:17:48.312 19:24:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:48.312 19:24:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:48.312 19:24:32 -- target/device_removal.sh@318 -- # clean_bond_device 00:17:48.312 19:24:32 -- target/device_removal.sh@240 -- # ip link 00:17:48.312 19:24:32 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:17:48.312 00:17:48.312 real 3m13.312s 00:17:48.312 user 8m53.026s 00:17:48.312 sys 0m14.088s 00:17:48.312 19:24:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:48.312 19:24:32 -- common/autotest_common.sh@10 -- # set +x 00:17:48.312 ************************************ 00:17:48.312 END TEST nvmf_device_removal 00:17:48.312 ************************************ 00:17:48.312 19:24:33 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:17:48.312 19:24:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:48.312 19:24:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:48.312 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:17:48.312 ************************************ 00:17:48.312 START TEST nvmf_srq_overwhelm 00:17:48.312 ************************************ 00:17:48.312 19:24:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:17:48.312 * Looking for test storage... 00:17:48.312 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:48.312 19:24:33 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:48.312 19:24:33 -- nvmf/common.sh@7 -- # uname -s 00:17:48.312 19:24:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:48.312 19:24:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:48.312 19:24:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:48.312 19:24:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:48.312 19:24:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:48.312 19:24:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:48.312 19:24:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:48.312 19:24:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:48.312 19:24:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:48.312 19:24:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:48.312 19:24:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:17:48.312 19:24:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:17:48.312 19:24:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:48.312 19:24:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:48.312 19:24:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:48.312 19:24:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:48.312 19:24:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:48.312 19:24:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:48.312 19:24:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:48.312 19:24:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:48.312 19:24:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.312 19:24:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.312 19:24:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.312 19:24:33 -- paths/export.sh@5 -- # export PATH 00:17:48.312 19:24:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:48.312 19:24:33 -- nvmf/common.sh@47 -- # : 0 00:17:48.312 19:24:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:48.312 19:24:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:48.312 19:24:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:48.312 19:24:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:48.312 19:24:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:48.312 19:24:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:48.312 19:24:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:48.312 19:24:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:48.312 19:24:33 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:48.312 19:24:33 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:48.312 19:24:33 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:17:48.312 19:24:33 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:17:48.312 19:24:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:48.312 19:24:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:48.312 19:24:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:48.312 19:24:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:48.312 19:24:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:48.312 19:24:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:48.312 19:24:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:48.312 19:24:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:48.312 19:24:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:48.312 19:24:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:48.312 19:24:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:48.312 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:17:52.527 19:24:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:52.527 19:24:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:52.527 19:24:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:52.527 19:24:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:52.527 19:24:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:52.527 19:24:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:52.527 19:24:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:52.527 19:24:39 -- nvmf/common.sh@295 -- # net_devs=() 00:17:52.527 19:24:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:52.527 19:24:39 -- nvmf/common.sh@296 -- # e810=() 00:17:52.527 19:24:39 -- nvmf/common.sh@296 -- # local -ga e810 00:17:52.527 19:24:39 -- nvmf/common.sh@297 -- # x722=() 00:17:52.527 19:24:39 -- nvmf/common.sh@297 -- # local -ga x722 00:17:52.527 19:24:39 -- nvmf/common.sh@298 -- # mlx=() 00:17:52.527 19:24:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:52.527 19:24:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:52.527 19:24:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:52.527 19:24:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:52.527 19:24:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:52.527 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:52.527 19:24:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:52.527 19:24:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:52.527 19:24:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:52.527 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:52.527 19:24:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:52.527 19:24:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:52.527 19:24:39 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:52.527 19:24:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.527 19:24:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:52.527 19:24:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.527 19:24:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:52.527 Found net devices under 0000:18:00.0: mlx_0_0 00:17:52.527 19:24:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:52.527 19:24:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.527 19:24:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:52.527 19:24:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.527 19:24:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:52.527 Found net devices under 0000:18:00.1: mlx_0_1 00:17:52.527 19:24:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.527 19:24:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:52.527 19:24:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:52.527 19:24:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:52.527 19:24:39 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:52.527 19:24:39 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:52.527 19:24:39 -- nvmf/common.sh@58 -- # uname 00:17:52.527 19:24:39 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:52.527 19:24:39 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:52.527 19:24:39 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:52.527 19:24:39 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:52.527 19:24:39 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:52.527 19:24:39 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:52.527 19:24:39 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:52.527 19:24:39 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:52.527 19:24:39 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:52.527 19:24:39 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:52.528 19:24:39 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:52.528 19:24:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:52.528 19:24:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:52.528 19:24:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:52.528 19:24:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:52.528 19:24:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:52.528 19:24:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.528 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.528 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:52.528 19:24:39 -- nvmf/common.sh@105 -- # continue 2 00:17:52.528 19:24:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.528 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.528 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.528 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:52.528 19:24:39 -- nvmf/common.sh@105 -- # continue 2 00:17:52.528 19:24:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:52.528 19:24:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:52.528 19:24:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.528 19:24:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:52.528 19:24:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:52.528 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:52.528 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:17:52.528 altname enp24s0f0np0 00:17:52.528 altname ens785f0np0 00:17:52.528 inet 192.168.100.8/24 scope global mlx_0_0 00:17:52.528 valid_lft forever preferred_lft forever 00:17:52.528 19:24:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:52.528 19:24:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:52.528 19:24:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.528 19:24:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.528 19:24:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:52.528 19:24:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:52.528 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:52.528 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:17:52.528 altname enp24s0f1np1 00:17:52.528 altname ens785f1np1 00:17:52.528 inet 192.168.100.9/24 scope global mlx_0_1 00:17:52.528 valid_lft forever preferred_lft forever 00:17:52.528 19:24:39 -- nvmf/common.sh@411 -- # return 0 00:17:52.528 19:24:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:52.528 19:24:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:52.528 19:24:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:52.528 19:24:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:52.528 19:24:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:52.528 19:24:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:52.528 19:24:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:52.528 19:24:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:52.528 19:24:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:52.827 19:24:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:52.827 19:24:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.827 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.827 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:52.827 19:24:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:52.827 19:24:39 -- nvmf/common.sh@105 -- # continue 2 00:17:52.827 19:24:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.827 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.827 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:52.827 19:24:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.827 19:24:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:52.827 19:24:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:52.827 19:24:39 -- nvmf/common.sh@105 -- # continue 2 00:17:52.827 19:24:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:52.827 19:24:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:52.827 19:24:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.827 19:24:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:52.827 19:24:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:52.827 19:24:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.827 19:24:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.827 19:24:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:52.827 192.168.100.9' 00:17:52.827 19:24:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:52.827 192.168.100.9' 00:17:52.827 19:24:39 -- nvmf/common.sh@446 -- # head -n 1 00:17:52.827 19:24:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:52.827 19:24:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:52.827 192.168.100.9' 00:17:52.827 19:24:39 -- nvmf/common.sh@447 -- # tail -n +2 00:17:52.827 19:24:39 -- nvmf/common.sh@447 -- # head -n 1 00:17:52.827 19:24:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:52.827 19:24:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:52.827 19:24:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:52.827 19:24:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:52.827 19:24:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:52.827 19:24:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:52.827 19:24:39 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:17:52.827 19:24:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:52.827 19:24:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:52.827 19:24:39 -- common/autotest_common.sh@10 -- # set +x 00:17:52.827 19:24:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:52.827 19:24:39 -- nvmf/common.sh@470 -- # nvmfpid=3047847 00:17:52.827 19:24:39 -- nvmf/common.sh@471 -- # waitforlisten 3047847 00:17:52.827 19:24:39 -- common/autotest_common.sh@817 -- # '[' -z 3047847 ']' 00:17:52.827 19:24:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:52.827 19:24:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:52.827 19:24:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:52.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:52.827 19:24:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:52.827 19:24:39 -- common/autotest_common.sh@10 -- # set +x 00:17:52.827 [2024-04-24 19:24:39.648710] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:17:52.827 [2024-04-24 19:24:39.648765] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:52.827 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.827 [2024-04-24 19:24:39.720450] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:52.827 [2024-04-24 19:24:39.814587] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:52.827 [2024-04-24 19:24:39.814625] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:52.827 [2024-04-24 19:24:39.814635] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:52.827 [2024-04-24 19:24:39.814644] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:52.827 [2024-04-24 19:24:39.814652] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:52.827 [2024-04-24 19:24:39.814703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:52.827 [2024-04-24 19:24:39.814790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.827 [2024-04-24 19:24:39.814867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:52.827 [2024-04-24 19:24:39.814869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:53.766 19:24:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:53.766 19:24:40 -- common/autotest_common.sh@850 -- # return 0 00:17:53.766 19:24:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:53.766 19:24:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 19:24:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:17:53.766 19:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 [2024-04-24 19:24:40.562187] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14dd240/0x14e1730) succeed. 00:17:53.766 [2024-04-24 19:24:40.572410] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14de880/0x1522dc0) succeed. 00:17:53.766 19:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:17:53.766 19:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 19:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:53.766 19:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 Malloc0 00:17:53.766 19:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:17:53.766 19:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 19:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.766 19:24:40 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:53.766 19:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.766 19:24:40 -- common/autotest_common.sh@10 -- # set +x 00:17:53.766 [2024-04-24 19:24:40.677891] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:53.767 19:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.767 19:24:40 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:17:54.703 19:24:41 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:17:54.703 19:24:41 -- common/autotest_common.sh@1221 -- # local i=0 00:17:54.703 19:24:41 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:17:54.703 19:24:41 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:17:54.703 19:24:41 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:17:54.703 19:24:41 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:17:54.703 19:24:41 -- common/autotest_common.sh@1232 -- # return 0 00:17:54.703 19:24:41 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:54.703 19:24:41 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:54.703 19:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:54.703 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:17:54.703 19:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:54.703 19:24:41 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:17:54.703 19:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:54.703 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:17:54.962 Malloc1 00:17:54.962 19:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:54.962 19:24:41 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:54.962 19:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:54.962 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:17:54.962 19:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:54.962 19:24:41 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:54.962 19:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:54.962 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:17:54.962 19:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:54.962 19:24:41 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:17:55.900 19:24:42 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:17:55.900 19:24:42 -- common/autotest_common.sh@1221 -- # local i=0 00:17:55.900 19:24:42 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:17:55.900 19:24:42 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:17:55.900 19:24:42 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:17:55.900 19:24:42 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:17:55.900 19:24:42 -- common/autotest_common.sh@1232 -- # return 0 00:17:55.900 19:24:42 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:55.900 19:24:42 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:17:55.900 19:24:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:55.900 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:17:55.900 19:24:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:55.900 19:24:42 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:17:55.900 19:24:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:55.900 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:17:55.901 Malloc2 00:17:55.901 19:24:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:55.901 19:24:42 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:17:55.901 19:24:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:55.901 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:17:55.901 19:24:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:55.901 19:24:42 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:17:55.901 19:24:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:55.901 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:17:55.901 19:24:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:55.901 19:24:42 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:17:56.838 19:24:43 -- common/autotest_common.sh@1221 -- # local i=0 00:17:56.838 19:24:43 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:17:56.838 19:24:43 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:17:56.838 19:24:43 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:17:56.838 19:24:43 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:17:56.838 19:24:43 -- common/autotest_common.sh@1232 -- # return 0 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:17:56.838 19:24:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:56.838 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:17:56.838 19:24:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:17:56.838 19:24:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:56.838 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:17:56.838 Malloc3 00:17:56.838 19:24:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:17:56.838 19:24:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:56.838 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:17:56.838 19:24:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:17:56.838 19:24:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:56.838 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:17:56.838 19:24:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:56.838 19:24:43 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:17:58.217 19:24:44 -- common/autotest_common.sh@1221 -- # local i=0 00:17:58.217 19:24:44 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:17:58.217 19:24:44 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:17:58.217 19:24:44 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:17:58.217 19:24:44 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:17:58.217 19:24:44 -- common/autotest_common.sh@1232 -- # return 0 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:17:58.217 19:24:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:58.217 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:17:58.217 19:24:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:17:58.217 19:24:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:58.217 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:17:58.217 Malloc4 00:17:58.217 19:24:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:17:58.217 19:24:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:58.217 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:17:58.217 19:24:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:17:58.217 19:24:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:58.217 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:17:58.217 19:24:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:58.217 19:24:44 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:17:59.154 19:24:45 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:17:59.154 19:24:45 -- common/autotest_common.sh@1221 -- # local i=0 00:17:59.155 19:24:45 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:17:59.155 19:24:45 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:17:59.155 19:24:45 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:17:59.155 19:24:45 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:17:59.155 19:24:45 -- common/autotest_common.sh@1232 -- # return 0 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:17:59.155 19:24:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:59.155 19:24:45 -- common/autotest_common.sh@10 -- # set +x 00:17:59.155 19:24:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:17:59.155 19:24:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:59.155 19:24:45 -- common/autotest_common.sh@10 -- # set +x 00:17:59.155 Malloc5 00:17:59.155 19:24:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:17:59.155 19:24:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:59.155 19:24:45 -- common/autotest_common.sh@10 -- # set +x 00:17:59.155 19:24:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:17:59.155 19:24:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:59.155 19:24:45 -- common/autotest_common.sh@10 -- # set +x 00:17:59.155 19:24:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:59.155 19:24:45 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:18:00.092 19:24:46 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:18:00.092 19:24:46 -- common/autotest_common.sh@1221 -- # local i=0 00:18:00.092 19:24:46 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:18:00.092 19:24:46 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:18:00.092 19:24:46 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:18:00.092 19:24:46 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:18:00.092 19:24:46 -- common/autotest_common.sh@1232 -- # return 0 00:18:00.092 19:24:46 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:18:00.092 [global] 00:18:00.092 thread=1 00:18:00.092 invalidate=1 00:18:00.092 rw=read 00:18:00.092 time_based=1 00:18:00.092 runtime=10 00:18:00.092 ioengine=libaio 00:18:00.092 direct=1 00:18:00.092 bs=1048576 00:18:00.092 iodepth=128 00:18:00.092 norandommap=1 00:18:00.092 numjobs=13 00:18:00.092 00:18:00.092 [job0] 00:18:00.092 filename=/dev/nvme0n1 00:18:00.092 [job1] 00:18:00.092 filename=/dev/nvme1n1 00:18:00.092 [job2] 00:18:00.092 filename=/dev/nvme2n1 00:18:00.092 [job3] 00:18:00.092 filename=/dev/nvme3n1 00:18:00.092 [job4] 00:18:00.092 filename=/dev/nvme4n1 00:18:00.092 [job5] 00:18:00.092 filename=/dev/nvme5n1 00:18:00.092 Could not set queue depth (nvme0n1) 00:18:00.092 Could not set queue depth (nvme1n1) 00:18:00.092 Could not set queue depth (nvme2n1) 00:18:00.092 Could not set queue depth (nvme3n1) 00:18:00.092 Could not set queue depth (nvme4n1) 00:18:00.092 Could not set queue depth (nvme5n1) 00:18:00.351 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:00.351 ... 00:18:00.351 fio-3.35 00:18:00.351 Starting 78 threads 00:18:15.238 00:18:15.238 job0: (groupid=0, jobs=1): err= 0: pid=3049022: Wed Apr 24 19:25:00 2024 00:18:15.238 read: IOPS=4, BW=4554KiB/s (4663kB/s)(56.0MiB/12593msec) 00:18:15.238 slat (usec): min=722, max=2110.3k, avg=186071.26, stdev=572994.41 00:18:15.238 clat (msec): min=2171, max=12588, avg=9909.29, stdev=3158.12 00:18:15.238 lat (msec): min=4232, max=12591, avg=10095.36, stdev=2996.80 00:18:15.238 clat percentiles (msec): 00:18:15.238 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 4329], 20.00th=[ 6477], 00:18:15.238 | 30.00th=[ 8557], 40.00th=[10671], 50.00th=[10805], 60.00th=[12416], 00:18:15.238 | 70.00th=[12416], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.238 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.238 | 99.99th=[12550] 00:18:15.238 lat (msec) : >=2000=100.00% 00:18:15.238 cpu : usr=0.00%, sys=0.44%, ctx=70, majf=0, minf=14337 00:18:15.238 IO depths : 1=1.8%, 2=3.6%, 4=7.1%, 8=14.3%, 16=28.6%, 32=44.6%, >=64=0.0% 00:18:15.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.238 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.238 issued rwts: total=56,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.238 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.238 job0: (groupid=0, jobs=1): err= 0: pid=3049023: Wed Apr 24 19:25:00 2024 00:18:15.238 read: IOPS=11, BW=11.7MiB/s (12.2MB/s)(148MiB/12673msec) 00:18:15.238 slat (usec): min=125, max=2044.9k, avg=70684.30, stdev=331318.96 00:18:15.238 clat (msec): min=2210, max=12630, avg=7314.74, stdev=2698.53 00:18:15.238 lat (msec): min=4143, max=12632, avg=7385.42, stdev=2700.52 00:18:15.238 clat percentiles (msec): 00:18:15.238 | 1.00th=[ 4144], 5.00th=[ 4279], 10.00th=[ 4279], 20.00th=[ 5738], 00:18:15.238 | 30.00th=[ 5805], 40.00th=[ 5940], 50.00th=[ 6141], 60.00th=[ 6342], 00:18:15.238 | 70.00th=[ 8356], 80.00th=[ 8658], 90.00th=[12550], 95.00th=[12550], 00:18:15.238 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.238 | 99.99th=[12684] 00:18:15.238 bw ( KiB/s): min= 1899, max=32768, per=0.52%, avg=14286.33, stdev=16311.94, samples=3 00:18:15.238 iops : min= 1, max= 32, avg=13.67, stdev=16.26, samples=3 00:18:15.238 lat (msec) : >=2000=100.00% 00:18:15.238 cpu : usr=0.00%, sys=1.03%, ctx=197, majf=0, minf=32769 00:18:15.238 IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.4%, 16=10.8%, 32=21.6%, >=64=57.4% 00:18:15.238 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.238 complete : 0=0.0%, 4=95.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=4.5% 00:18:15.238 issued rwts: total=148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.238 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049024: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=2, BW=2609KiB/s (2671kB/s)(32.0MiB/12562msec) 00:18:15.239 slat (usec): min=860, max=2107.7k, avg=325038.36, stdev=736816.74 00:18:15.239 clat (msec): min=2160, max=12532, avg=8566.65, stdev=2911.37 00:18:15.239 lat (msec): min=4256, max=12561, avg=8891.69, stdev=2749.16 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[ 6409], 00:18:15.239 | 30.00th=[ 6477], 40.00th=[ 6477], 50.00th=[ 8557], 60.00th=[10671], 00:18:15.239 | 70.00th=[10671], 80.00th=[10805], 90.00th=[12550], 95.00th=[12550], 00:18:15.239 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.239 | 99.99th=[12550] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.24%, ctx=59, majf=0, minf=8193 00:18:15.239 IO depths : 1=3.1%, 2=6.2%, 4=12.5%, 8=25.0%, 16=50.0%, 32=3.1%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.239 issued rwts: total=32,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049025: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=2, BW=2372KiB/s (2429kB/s)(29.0MiB/12521msec) 00:18:15.239 slat (usec): min=760, max=2115.1k, avg=356944.44, stdev=767937.56 00:18:15.239 clat (msec): min=2169, max=12471, avg=10285.77, stdev=3046.32 00:18:15.239 lat (msec): min=4251, max=12520, avg=10642.72, stdev=2640.77 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 4329], 20.00th=[ 6477], 00:18:15.239 | 30.00th=[10671], 40.00th=[10805], 50.00th=[12416], 60.00th=[12416], 00:18:15.239 | 70.00th=[12416], 80.00th=[12416], 90.00th=[12416], 95.00th=[12416], 00:18:15.239 | 99.00th=[12416], 99.50th=[12416], 99.90th=[12416], 99.95th=[12416], 00:18:15.239 | 99.99th=[12416] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.22%, ctx=49, majf=0, minf=7425 00:18:15.239 IO depths : 1=3.4%, 2=6.9%, 4=13.8%, 8=27.6%, 16=48.3%, 32=0.0%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.239 issued rwts: total=29,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049026: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=3, BW=4041KiB/s (4138kB/s)(50.0MiB/12670msec) 00:18:15.239 slat (usec): min=669, max=2119.9k, avg=210071.96, stdev=607159.71 00:18:15.239 clat (msec): min=2165, max=12667, avg=10968.49, stdev=2867.88 00:18:15.239 lat (msec): min=4238, max=12669, avg=11178.56, stdev=2580.15 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4279], 10.00th=[ 6409], 20.00th=[ 8557], 00:18:15.239 | 30.00th=[10805], 40.00th=[12550], 50.00th=[12550], 60.00th=[12550], 00:18:15.239 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.239 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.239 | 99.99th=[12684] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.42%, ctx=94, majf=0, minf=12801 00:18:15.239 IO depths : 1=2.0%, 2=4.0%, 4=8.0%, 8=16.0%, 16=32.0%, 32=38.0%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.239 issued rwts: total=50,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049028: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=2, BW=2510KiB/s (2570kB/s)(31.0MiB/12646msec) 00:18:15.239 slat (usec): min=1313, max=2151.1k, avg=338341.27, stdev=762389.77 00:18:15.239 clat (msec): min=2156, max=12642, avg=11336.73, stdev=2702.44 00:18:15.239 lat (msec): min=4307, max=12645, avg=11675.07, stdev=2105.45 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4329], 10.00th=[ 8557], 20.00th=[10671], 00:18:15.239 | 30.00th=[12550], 40.00th=[12550], 50.00th=[12550], 60.00th=[12684], 00:18:15.239 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.239 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.239 | 99.99th=[12684] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.28%, ctx=70, majf=0, minf=7937 00:18:15.239 IO depths : 1=3.2%, 2=6.5%, 4=12.9%, 8=25.8%, 16=51.6%, 32=0.0%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.239 issued rwts: total=31,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049029: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=1, BW=1783KiB/s (1826kB/s)(22.0MiB/12633msec) 00:18:15.239 slat (usec): min=924, max=4273.5k, avg=475435.13, stdev=1095334.27 00:18:15.239 clat (msec): min=2173, max=12628, avg=11205.91, stdev=2811.92 00:18:15.239 lat (msec): min=4263, max=12632, avg=11681.35, stdev=1970.18 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4279], 10.00th=[ 8557], 20.00th=[10671], 00:18:15.239 | 30.00th=[10805], 40.00th=[12416], 50.00th=[12550], 60.00th=[12550], 00:18:15.239 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.239 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.239 | 99.99th=[12684] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.18%, ctx=65, majf=0, minf=5633 00:18:15.239 IO depths : 1=4.5%, 2=9.1%, 4=18.2%, 8=36.4%, 16=31.8%, 32=0.0%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.239 issued rwts: total=22,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049030: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=2, BW=2122KiB/s (2173kB/s)(26.0MiB/12544msec) 00:18:15.239 slat (usec): min=1026, max=2137.6k, avg=398837.95, stdev=800786.68 00:18:15.239 clat (msec): min=2173, max=12541, avg=10108.80, stdev=3229.02 00:18:15.239 lat (msec): min=4240, max=12543, avg=10507.64, stdev=2824.79 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 4245], 20.00th=[ 6477], 00:18:15.239 | 30.00th=[ 8557], 40.00th=[10671], 50.00th=[12416], 60.00th=[12416], 00:18:15.239 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.239 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.239 | 99.99th=[12550] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.01%, sys=0.19%, ctx=56, majf=0, minf=6657 00:18:15.239 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.239 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049031: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=4, BW=4993KiB/s (5113kB/s)(61.0MiB/12510msec) 00:18:15.239 slat (usec): min=906, max=2074.8k, avg=170031.45, stdev=525053.84 00:18:15.239 clat (msec): min=2136, max=12494, avg=7065.83, stdev=2074.14 00:18:15.239 lat (msec): min=4211, max=12508, avg=7235.86, stdev=2088.43 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 2140], 5.00th=[ 5873], 10.00th=[ 5940], 20.00th=[ 6007], 00:18:15.239 | 30.00th=[ 6074], 40.00th=[ 6141], 50.00th=[ 6275], 60.00th=[ 6342], 00:18:15.239 | 70.00th=[ 6477], 80.00th=[ 8557], 90.00th=[10671], 95.00th=[10671], 00:18:15.239 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.239 | 99.99th=[12550] 00:18:15.239 lat (msec) : >=2000=100.00% 00:18:15.239 cpu : usr=0.00%, sys=0.44%, ctx=109, majf=0, minf=15617 00:18:15.239 IO depths : 1=1.6%, 2=3.3%, 4=6.6%, 8=13.1%, 16=26.2%, 32=49.2%, >=64=0.0% 00:18:15.239 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.239 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.239 issued rwts: total=61,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.239 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.239 job0: (groupid=0, jobs=1): err= 0: pid=3049032: Wed Apr 24 19:25:00 2024 00:18:15.239 read: IOPS=85, BW=85.1MiB/s (89.3MB/s)(888MiB/10430msec) 00:18:15.239 slat (usec): min=47, max=2051.1k, avg=11257.74, stdev=106130.67 00:18:15.239 clat (msec): min=429, max=6895, avg=1238.60, stdev=1346.28 00:18:15.239 lat (msec): min=436, max=6896, avg=1249.86, stdev=1359.95 00:18:15.239 clat percentiles (msec): 00:18:15.239 | 1.00th=[ 451], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 531], 00:18:15.239 | 30.00th=[ 592], 40.00th=[ 667], 50.00th=[ 718], 60.00th=[ 735], 00:18:15.239 | 70.00th=[ 810], 80.00th=[ 911], 90.00th=[ 4178], 95.00th=[ 4329], 00:18:15.239 | 99.00th=[ 5067], 99.50th=[ 6879], 99.90th=[ 6879], 99.95th=[ 6879], 00:18:15.239 | 99.99th=[ 6879] 00:18:15.239 bw ( KiB/s): min= 8192, max=241664, per=5.61%, avg=154774.30, stdev=73405.04, samples=10 00:18:15.239 iops : min= 8, max= 236, avg=151.00, stdev=71.63, samples=10 00:18:15.240 lat (msec) : 500=2.82%, 750=60.14%, 1000=20.61%, >=2000=16.44% 00:18:15.240 cpu : usr=0.03%, sys=1.65%, ctx=762, majf=0, minf=32769 00:18:15.240 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=92.9% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.240 issued rwts: total=888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job0: (groupid=0, jobs=1): err= 0: pid=3049033: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=32, BW=32.2MiB/s (33.8MB/s)(403MiB/12497msec) 00:18:15.240 slat (usec): min=76, max=2119.9k, avg=25662.58, stdev=197613.47 00:18:15.240 clat (msec): min=437, max=11457, avg=3848.55, stdev=3466.44 00:18:15.240 lat (msec): min=439, max=11457, avg=3874.21, stdev=3485.27 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 439], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 451], 00:18:15.240 | 30.00th=[ 472], 40.00th=[ 535], 50.00th=[ 3809], 60.00th=[ 4077], 00:18:15.240 | 70.00th=[ 7483], 80.00th=[ 7617], 90.00th=[ 7752], 95.00th=[11342], 00:18:15.240 | 99.00th=[11476], 99.50th=[11476], 99.90th=[11476], 99.95th=[11476], 00:18:15.240 | 99.99th=[11476] 00:18:15.240 bw ( KiB/s): min= 2052, max=276480, per=2.56%, avg=70656.50, stdev=92616.80, samples=8 00:18:15.240 iops : min= 2, max= 270, avg=69.00, stdev=90.45, samples=8 00:18:15.240 lat (msec) : 500=38.46%, 750=3.72%, 2000=0.74%, >=2000=57.07% 00:18:15.240 cpu : usr=0.00%, sys=1.14%, ctx=409, majf=0, minf=32769 00:18:15.240 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=7.9%, >=64=84.4% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:15.240 issued rwts: total=403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job0: (groupid=0, jobs=1): err= 0: pid=3049034: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=96, BW=97.0MiB/s (102MB/s)(1211MiB/12485msec) 00:18:15.240 slat (usec): min=47, max=2169.1k, avg=8254.12, stdev=92101.76 00:18:15.240 clat (msec): min=255, max=6426, avg=1093.61, stdev=1005.65 00:18:15.240 lat (msec): min=256, max=8595, avg=1101.86, stdev=1028.42 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 292], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 376], 00:18:15.240 | 30.00th=[ 405], 40.00th=[ 426], 50.00th=[ 506], 60.00th=[ 550], 00:18:15.240 | 70.00th=[ 2123], 80.00th=[ 2500], 90.00th=[ 2601], 95.00th=[ 2601], 00:18:15.240 | 99.00th=[ 2735], 99.50th=[ 4245], 99.90th=[ 6342], 99.95th=[ 6409], 00:18:15.240 | 99.99th=[ 6409] 00:18:15.240 bw ( KiB/s): min=40960, max=338051, per=7.74%, avg=213619.50, stdev=113449.81, samples=10 00:18:15.240 iops : min= 40, max= 330, avg=208.60, stdev=110.78, samples=10 00:18:15.240 lat (msec) : 500=49.30%, 750=19.32%, >=2000=31.38% 00:18:15.240 cpu : usr=0.02%, sys=1.43%, ctx=1155, majf=0, minf=32769 00:18:15.240 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.6%, >=64=94.8% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.240 issued rwts: total=1211,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job0: (groupid=0, jobs=1): err= 0: pid=3049035: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=2, BW=2930KiB/s (3001kB/s)(36.0MiB/12580msec) 00:18:15.240 slat (usec): min=780, max=2102.2k, avg=289274.48, stdev=697278.45 00:18:15.240 clat (msec): min=2165, max=12576, avg=8379.09, stdev=3134.99 00:18:15.240 lat (msec): min=4237, max=12579, avg=8668.36, stdev=3023.75 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[ 6409], 00:18:15.240 | 30.00th=[ 6409], 40.00th=[ 6477], 50.00th=[ 8557], 60.00th=[ 8557], 00:18:15.240 | 70.00th=[10671], 80.00th=[12416], 90.00th=[12550], 95.00th=[12550], 00:18:15.240 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.240 | 99.99th=[12550] 00:18:15.240 lat (msec) : >=2000=100.00% 00:18:15.240 cpu : usr=0.00%, sys=0.29%, ctx=67, majf=0, minf=9217 00:18:15.240 IO depths : 1=2.8%, 2=5.6%, 4=11.1%, 8=22.2%, 16=44.4%, 32=13.9%, >=64=0.0% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.240 issued rwts: total=36,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job1: (groupid=0, jobs=1): err= 0: pid=3049054: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=148, BW=148MiB/s (156MB/s)(1857MiB/12513msec) 00:18:15.240 slat (usec): min=36, max=4260.2k, avg=5606.12, stdev=110601.59 00:18:15.240 clat (msec): min=107, max=8786, avg=832.64, stdev=2123.96 00:18:15.240 lat (msec): min=107, max=8787, avg=838.25, stdev=2131.31 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 128], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 136], 00:18:15.240 | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 236], 00:18:15.240 | 70.00th=[ 418], 80.00th=[ 472], 90.00th=[ 617], 95.00th=[ 8658], 00:18:15.240 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:18:15.240 | 99.99th=[ 8792] 00:18:15.240 bw ( KiB/s): min= 2048, max=968704, per=12.84%, avg=354304.40, stdev=340344.31, samples=10 00:18:15.240 iops : min= 2, max= 946, avg=346.00, stdev=332.37, samples=10 00:18:15.240 lat (msec) : 250=62.57%, 500=20.25%, 750=10.07%, >=2000=7.11% 00:18:15.240 cpu : usr=0.02%, sys=1.77%, ctx=1669, majf=0, minf=32769 00:18:15.240 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.9%, 32=1.7%, >=64=96.6% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.240 issued rwts: total=1857,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job1: (groupid=0, jobs=1): err= 0: pid=3049056: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=251, BW=251MiB/s (263MB/s)(3177MiB/12655msec) 00:18:15.240 slat (usec): min=44, max=1328.8k, avg=3324.55, stdev=24499.27 00:18:15.240 clat (msec): min=136, max=3666, avg=493.45, stdev=640.94 00:18:15.240 lat (msec): min=138, max=3669, avg=496.77, stdev=642.54 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 142], 20.00th=[ 146], 00:18:15.240 | 30.00th=[ 264], 40.00th=[ 347], 50.00th=[ 401], 60.00th=[ 426], 00:18:15.240 | 70.00th=[ 477], 80.00th=[ 558], 90.00th=[ 609], 95.00th=[ 676], 00:18:15.240 | 99.00th=[ 3608], 99.50th=[ 3641], 99.90th=[ 3675], 99.95th=[ 3675], 00:18:15.240 | 99.99th=[ 3675] 00:18:15.240 bw ( KiB/s): min= 2048, max=892928, per=11.91%, avg=328709.00, stdev=217009.23, samples=19 00:18:15.240 iops : min= 2, max= 872, avg=320.95, stdev=211.95, samples=19 00:18:15.240 lat (msec) : 250=25.18%, 500=47.18%, 750=23.61%, 2000=0.03%, >=2000=4.00% 00:18:15.240 cpu : usr=0.09%, sys=3.32%, ctx=2863, majf=0, minf=32769 00:18:15.240 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=98.0% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.240 issued rwts: total=3177,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job1: (groupid=0, jobs=1): err= 0: pid=3049057: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=5, BW=5252KiB/s (5378kB/s)(65.0MiB/12673msec) 00:18:15.240 slat (usec): min=949, max=4275.5k, avg=162813.49, stdev=667240.70 00:18:15.240 clat (msec): min=2089, max=12671, avg=11433.00, stdev=2850.57 00:18:15.240 lat (msec): min=4229, max=12672, avg=11595.82, stdev=2599.75 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 2089], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[12416], 00:18:15.240 | 30.00th=[12550], 40.00th=[12550], 50.00th=[12550], 60.00th=[12684], 00:18:15.240 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.240 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.240 | 99.99th=[12684] 00:18:15.240 lat (msec) : >=2000=100.00% 00:18:15.240 cpu : usr=0.00%, sys=0.55%, ctx=81, majf=0, minf=16641 00:18:15.240 IO depths : 1=1.5%, 2=3.1%, 4=6.2%, 8=12.3%, 16=24.6%, 32=49.2%, >=64=3.1% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.240 issued rwts: total=65,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job1: (groupid=0, jobs=1): err= 0: pid=3049058: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=0, BW=982KiB/s (1005kB/s)(12.0MiB/12515msec) 00:18:15.240 slat (msec): min=4, max=2147, avg=869.70, stdev=1049.70 00:18:15.240 clat (msec): min=2077, max=12427, avg=8210.73, stdev=3874.99 00:18:15.240 lat (msec): min=4225, max=12514, avg=9080.43, stdev=3529.08 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 2072], 5.00th=[ 2072], 10.00th=[ 4212], 20.00th=[ 4245], 00:18:15.240 | 30.00th=[ 4279], 40.00th=[ 6342], 50.00th=[ 8490], 60.00th=[10671], 00:18:15.240 | 70.00th=[12416], 80.00th=[12416], 90.00th=[12416], 95.00th=[12416], 00:18:15.240 | 99.00th=[12416], 99.50th=[12416], 99.90th=[12416], 99.95th=[12416], 00:18:15.240 | 99.99th=[12416] 00:18:15.240 lat (msec) : >=2000=100.00% 00:18:15.240 cpu : usr=0.00%, sys=0.10%, ctx=35, majf=0, minf=3073 00:18:15.240 IO depths : 1=8.3%, 2=16.7%, 4=33.3%, 8=41.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:15.240 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.240 issued rwts: total=12,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.240 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.240 job1: (groupid=0, jobs=1): err= 0: pid=3049059: Wed Apr 24 19:25:00 2024 00:18:15.240 read: IOPS=2, BW=2917KiB/s (2987kB/s)(36.0MiB/12639msec) 00:18:15.240 slat (usec): min=1076, max=4245.5k, avg=292347.39, stdev=879446.77 00:18:15.240 clat (msec): min=2113, max=12637, avg=11610.02, stdev=2700.70 00:18:15.240 lat (msec): min=4247, max=12638, avg=11902.37, stdev=2158.63 00:18:15.240 clat percentiles (msec): 00:18:15.240 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 6409], 20.00th=[12416], 00:18:15.240 | 30.00th=[12550], 40.00th=[12550], 50.00th=[12550], 60.00th=[12550], 00:18:15.240 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.240 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.240 | 99.99th=[12684] 00:18:15.240 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.32%, ctx=68, majf=0, minf=9217 00:18:15.241 IO depths : 1=2.8%, 2=5.6%, 4=11.1%, 8=22.2%, 16=44.4%, 32=13.9%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=36,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049060: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3091KiB/s (3165kB/s)(38.0MiB/12590msec) 00:18:15.241 slat (usec): min=947, max=4273.6k, avg=275799.55, stdev=855659.39 00:18:15.241 clat (msec): min=2109, max=12587, avg=9956.13, stdev=3650.13 00:18:15.241 lat (msec): min=4240, max=12589, avg=10231.93, stdev=3430.56 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2106], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[ 4329], 00:18:15.241 | 30.00th=[ 6409], 40.00th=[12416], 50.00th=[12416], 60.00th=[12550], 00:18:15.241 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.241 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.241 | 99.99th=[12550] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.33%, ctx=49, majf=0, minf=9729 00:18:15.241 IO depths : 1=2.6%, 2=5.3%, 4=10.5%, 8=21.1%, 16=42.1%, 32=18.4%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=38,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049061: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=2, BW=2686KiB/s (2750kB/s)(33.0MiB/12581msec) 00:18:15.241 slat (usec): min=921, max=2148.9k, avg=318287.25, stdev=745639.53 00:18:15.241 clat (msec): min=2077, max=12577, avg=10707.52, stdev=3301.93 00:18:15.241 lat (msec): min=4212, max=12580, avg=11025.81, stdev=2929.22 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2072], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 8490], 00:18:15.241 | 30.00th=[12416], 40.00th=[12416], 50.00th=[12416], 60.00th=[12550], 00:18:15.241 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.241 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.241 | 99.99th=[12550] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.26%, ctx=51, majf=0, minf=8449 00:18:15.241 IO depths : 1=3.0%, 2=6.1%, 4=12.1%, 8=24.2%, 16=48.5%, 32=6.1%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=33,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049062: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3561KiB/s (3646kB/s)(44.0MiB/12653msec) 00:18:15.241 slat (usec): min=998, max=4240.9k, avg=239659.06, stdev=798354.75 00:18:15.241 clat (msec): min=2106, max=12649, avg=11613.78, stdev=2601.21 00:18:15.241 lat (msec): min=4228, max=12652, avg=11853.44, stdev=2151.92 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2106], 5.00th=[ 4279], 10.00th=[ 6409], 20.00th=[12416], 00:18:15.241 | 30.00th=[12550], 40.00th=[12550], 50.00th=[12550], 60.00th=[12684], 00:18:15.241 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.241 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.241 | 99.99th=[12684] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.40%, ctx=73, majf=0, minf=11265 00:18:15.241 IO depths : 1=2.3%, 2=4.5%, 4=9.1%, 8=18.2%, 16=36.4%, 32=29.5%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=44,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049063: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=47, BW=47.0MiB/s (49.3MB/s)(592MiB/12584msec) 00:18:15.241 slat (usec): min=57, max=2194.9k, avg=17679.85, stdev=172839.60 00:18:15.241 clat (msec): min=283, max=11006, avg=2627.36, stdev=4085.47 00:18:15.241 lat (msec): min=286, max=11009, avg=2645.04, stdev=4098.58 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 292], 20.00th=[ 313], 00:18:15.241 | 30.00th=[ 321], 40.00th=[ 368], 50.00th=[ 447], 60.00th=[ 477], 00:18:15.241 | 70.00th=[ 567], 80.00th=[ 6745], 90.00th=[10805], 95.00th=[10939], 00:18:15.241 | 99.00th=[10939], 99.50th=[10939], 99.90th=[11073], 99.95th=[11073], 00:18:15.241 | 99.99th=[11073] 00:18:15.241 bw ( KiB/s): min= 1389, max=411648, per=4.93%, avg=135947.43, stdev=165494.77, samples=7 00:18:15.241 iops : min= 1, max= 402, avg=132.57, stdev=161.78, samples=7 00:18:15.241 lat (msec) : 500=69.26%, 750=5.41%, >=2000=25.34% 00:18:15.241 cpu : usr=0.06%, sys=1.44%, ctx=499, majf=0, minf=32769 00:18:15.241 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.4%, >=64=89.4% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:15.241 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049064: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3345KiB/s (3425kB/s)(41.0MiB/12552msec) 00:18:15.241 slat (usec): min=818, max=2136.8k, avg=254461.99, stdev=664122.01 00:18:15.241 clat (msec): min=2117, max=12549, avg=9154.84, stdev=3539.67 00:18:15.241 lat (msec): min=4223, max=12550, avg=9409.31, stdev=3393.12 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 4245], 20.00th=[ 4329], 00:18:15.241 | 30.00th=[ 6409], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[10671], 00:18:15.241 | 70.00th=[12416], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.241 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.241 | 99.99th=[12550] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.30%, ctx=61, majf=0, minf=10497 00:18:15.241 IO depths : 1=2.4%, 2=4.9%, 4=9.8%, 8=19.5%, 16=39.0%, 32=24.4%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=41,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049065: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3562KiB/s (3648kB/s)(44.0MiB/12648msec) 00:18:15.241 slat (usec): min=1031, max=4232.8k, avg=239400.40, stdev=794919.63 00:18:15.241 clat (msec): min=2113, max=12645, avg=11267.85, stdev=2904.07 00:18:15.241 lat (msec): min=4247, max=12647, avg=11507.25, stdev=2543.69 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2106], 5.00th=[ 4279], 10.00th=[ 6409], 20.00th=[10671], 00:18:15.241 | 30.00th=[12550], 40.00th=[12550], 50.00th=[12550], 60.00th=[12550], 00:18:15.241 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.241 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.241 | 99.99th=[12684] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.38%, ctx=82, majf=0, minf=11265 00:18:15.241 IO depths : 1=2.3%, 2=4.5%, 4=9.1%, 8=18.2%, 16=36.4%, 32=29.5%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=44,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049066: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3343KiB/s (3423kB/s)(41.0MiB/12560msec) 00:18:15.241 slat (usec): min=648, max=2106.2k, avg=254637.94, stdev=673212.39 00:18:15.241 clat (msec): min=2118, max=12557, avg=9163.98, stdev=3371.05 00:18:15.241 lat (msec): min=4208, max=12559, avg=9418.62, stdev=3216.34 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 6342], 00:18:15.241 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[10671], 00:18:15.241 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.241 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.241 | 99.99th=[12550] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.01%, sys=0.32%, ctx=51, majf=0, minf=10497 00:18:15.241 IO depths : 1=2.4%, 2=4.9%, 4=9.8%, 8=19.5%, 16=39.0%, 32=24.4%, >=64=0.0% 00:18:15.241 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.241 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.241 issued rwts: total=41,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.241 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.241 job1: (groupid=0, jobs=1): err= 0: pid=3049067: Wed Apr 24 19:25:00 2024 00:18:15.241 read: IOPS=3, BW=3413KiB/s (3495kB/s)(42.0MiB/12600msec) 00:18:15.241 slat (usec): min=934, max=4275.0k, avg=249627.92, stdev=816156.78 00:18:15.241 clat (msec): min=2115, max=12595, avg=10301.83, stdev=3414.41 00:18:15.241 lat (msec): min=4220, max=12599, avg=10551.45, stdev=3176.22 00:18:15.241 clat percentiles (msec): 00:18:15.241 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[ 6342], 00:18:15.241 | 30.00th=[10671], 40.00th=[10671], 50.00th=[12416], 60.00th=[12416], 00:18:15.241 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.241 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.241 | 99.99th=[12550] 00:18:15.241 lat (msec) : >=2000=100.00% 00:18:15.241 cpu : usr=0.00%, sys=0.33%, ctx=55, majf=0, minf=10753 00:18:15.241 IO depths : 1=2.4%, 2=4.8%, 4=9.5%, 8=19.0%, 16=38.1%, 32=26.2%, >=64=0.0% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.242 issued rwts: total=42,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049075: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=3, BW=3494KiB/s (3578kB/s)(43.0MiB/12602msec) 00:18:15.242 slat (usec): min=1019, max=2106.5k, avg=244246.67, stdev=657643.22 00:18:15.242 clat (msec): min=2098, max=12598, avg=10503.12, stdev=3169.78 00:18:15.242 lat (msec): min=4188, max=12601, avg=10747.37, stdev=2899.92 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 2106], 5.00th=[ 4212], 10.00th=[ 4279], 20.00th=[ 6409], 00:18:15.242 | 30.00th=[10671], 40.00th=[12550], 50.00th=[12550], 60.00th=[12550], 00:18:15.242 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.242 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.242 | 99.99th=[12550] 00:18:15.242 lat (msec) : >=2000=100.00% 00:18:15.242 cpu : usr=0.00%, sys=0.37%, ctx=66, majf=0, minf=11009 00:18:15.242 IO depths : 1=2.3%, 2=4.7%, 4=9.3%, 8=18.6%, 16=37.2%, 32=27.9%, >=64=0.0% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.242 issued rwts: total=43,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049076: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=4, BW=4494KiB/s (4602kB/s)(55.0MiB/12531msec) 00:18:15.242 slat (usec): min=641, max=2076.9k, avg=189564.13, stdev=577214.30 00:18:15.242 clat (msec): min=2104, max=12527, avg=9096.05, stdev=3217.15 00:18:15.242 lat (msec): min=4166, max=12530, avg=9285.61, stdev=3102.70 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 2106], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:18:15.242 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[10671], 00:18:15.242 | 70.00th=[12416], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.242 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.242 | 99.99th=[12550] 00:18:15.242 lat (msec) : >=2000=100.00% 00:18:15.242 cpu : usr=0.00%, sys=0.45%, ctx=64, majf=0, minf=14081 00:18:15.242 IO depths : 1=1.8%, 2=3.6%, 4=7.3%, 8=14.5%, 16=29.1%, 32=43.6%, >=64=0.0% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.242 issued rwts: total=55,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049077: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=6, BW=7056KiB/s (7226kB/s)(87.0MiB/12625msec) 00:18:15.242 slat (usec): min=716, max=2080.3k, avg=120756.48, stdev=464306.28 00:18:15.242 clat (msec): min=2118, max=12622, avg=10124.32, stdev=3320.08 00:18:15.242 lat (msec): min=4184, max=12624, avg=10245.08, stdev=3214.91 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 6342], 00:18:15.242 | 30.00th=[ 8557], 40.00th=[10671], 50.00th=[12416], 60.00th=[12550], 00:18:15.242 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12684], 00:18:15.242 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.242 | 99.99th=[12684] 00:18:15.242 lat (msec) : >=2000=100.00% 00:18:15.242 cpu : usr=0.00%, sys=0.67%, ctx=102, majf=0, minf=22273 00:18:15.242 IO depths : 1=1.1%, 2=2.3%, 4=4.6%, 8=9.2%, 16=18.4%, 32=36.8%, >=64=27.6% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.242 issued rwts: total=87,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049078: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=11, BW=11.9MiB/s (12.5MB/s)(150MiB/12579msec) 00:18:15.242 slat (usec): min=422, max=2053.2k, avg=69495.06, stdev=318994.49 00:18:15.242 clat (msec): min=2153, max=12404, avg=6366.14, stdev=1613.12 00:18:15.242 lat (msec): min=4045, max=12412, avg=6435.63, stdev=1651.59 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 4044], 5.00th=[ 4178], 10.00th=[ 5201], 20.00th=[ 5470], 00:18:15.242 | 30.00th=[ 5604], 40.00th=[ 5805], 50.00th=[ 6007], 60.00th=[ 6141], 00:18:15.242 | 70.00th=[ 6275], 80.00th=[ 7282], 90.00th=[ 8356], 95.00th=[ 8557], 00:18:15.242 | 99.00th=[12416], 99.50th=[12416], 99.90th=[12416], 99.95th=[12416], 00:18:15.242 | 99.99th=[12416] 00:18:15.242 bw ( KiB/s): min= 1505, max=22483, per=0.42%, avg=11618.75, stdev=11397.60, samples=4 00:18:15.242 iops : min= 1, max= 21, avg=10.75, stdev=10.72, samples=4 00:18:15.242 lat (msec) : >=2000=100.00% 00:18:15.242 cpu : usr=0.00%, sys=0.85%, ctx=236, majf=0, minf=32769 00:18:15.242 IO depths : 1=0.7%, 2=1.3%, 4=2.7%, 8=5.3%, 16=10.7%, 32=21.3%, >=64=58.0% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=95.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=4.2% 00:18:15.242 issued rwts: total=150,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049080: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=116, BW=116MiB/s (122MB/s)(1226MiB/10544msec) 00:18:15.242 slat (usec): min=46, max=2090.7k, avg=8153.20, stdev=84827.53 00:18:15.242 clat (msec): min=230, max=6815, avg=803.85, stdev=940.68 00:18:15.242 lat (msec): min=242, max=6828, avg=812.01, stdev=961.86 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 243], 5.00th=[ 247], 10.00th=[ 251], 20.00th=[ 330], 00:18:15.242 | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 380], 60.00th=[ 447], 00:18:15.242 | 70.00th=[ 776], 80.00th=[ 1301], 90.00th=[ 1536], 95.00th=[ 1703], 00:18:15.242 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 6812], 99.95th=[ 6812], 00:18:15.242 | 99.99th=[ 6812] 00:18:15.242 bw ( KiB/s): min=77824, max=406738, per=9.06%, avg=250031.22, stdev=127017.13, samples=9 00:18:15.242 iops : min= 76, max= 397, avg=243.89, stdev=123.97, samples=9 00:18:15.242 lat (msec) : 250=7.50%, 500=53.67%, 750=6.12%, 1000=8.81%, 2000=19.49% 00:18:15.242 lat (msec) : >=2000=4.40% 00:18:15.242 cpu : usr=0.03%, sys=1.72%, ctx=1275, majf=0, minf=32769 00:18:15.242 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.6%, >=64=94.9% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.242 issued rwts: total=1226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049081: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=69, BW=69.9MiB/s (73.3MB/s)(730MiB/10449msec) 00:18:15.242 slat (usec): min=39, max=2093.3k, avg=13728.44, stdev=129756.84 00:18:15.242 clat (msec): min=423, max=6951, avg=852.20, stdev=1013.74 00:18:15.242 lat (msec): min=459, max=6997, avg=865.92, stdev=1052.93 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 464], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 510], 00:18:15.242 | 30.00th=[ 550], 40.00th=[ 617], 50.00th=[ 684], 60.00th=[ 743], 00:18:15.242 | 70.00th=[ 793], 80.00th=[ 827], 90.00th=[ 860], 95.00th=[ 902], 00:18:15.242 | 99.00th=[ 6946], 99.50th=[ 6946], 99.90th=[ 6946], 99.95th=[ 6946], 00:18:15.242 | 99.99th=[ 6946] 00:18:15.242 bw ( KiB/s): min=40960, max=251904, per=6.35%, avg=175081.71, stdev=76323.72, samples=7 00:18:15.242 iops : min= 40, max= 246, avg=170.86, stdev=74.40, samples=7 00:18:15.242 lat (msec) : 500=2.33%, 750=59.86%, 1000=34.52%, >=2000=3.29% 00:18:15.242 cpu : usr=0.00%, sys=1.53%, ctx=625, majf=0, minf=32769 00:18:15.242 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.2%, 32=4.4%, >=64=91.4% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:15.242 issued rwts: total=730,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049082: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=1, BW=1065KiB/s (1090kB/s)(13.0MiB/12501msec) 00:18:15.242 slat (msec): min=22, max=2106, avg=799.47, stdev=1019.98 00:18:15.242 clat (msec): min=2107, max=10663, avg=6535.96, stdev=2679.31 00:18:15.242 lat (msec): min=4197, max=12500, avg=7335.43, stdev=2795.93 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 2106], 5.00th=[ 2106], 10.00th=[ 4212], 20.00th=[ 4212], 00:18:15.242 | 30.00th=[ 4245], 40.00th=[ 6342], 50.00th=[ 6342], 60.00th=[ 6409], 00:18:15.242 | 70.00th=[ 8490], 80.00th=[ 8490], 90.00th=[10671], 95.00th=[10671], 00:18:15.242 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:18:15.242 | 99.99th=[10671] 00:18:15.242 lat (msec) : >=2000=100.00% 00:18:15.242 cpu : usr=0.00%, sys=0.11%, ctx=40, majf=0, minf=3329 00:18:15.242 IO depths : 1=7.7%, 2=15.4%, 4=30.8%, 8=46.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:15.242 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.242 issued rwts: total=13,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.242 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.242 job2: (groupid=0, jobs=1): err= 0: pid=3049083: Wed Apr 24 19:25:00 2024 00:18:15.242 read: IOPS=39, BW=39.9MiB/s (41.9MB/s)(498MiB/12475msec) 00:18:15.242 slat (usec): min=59, max=2141.0k, avg=20798.49, stdev=179818.87 00:18:15.242 clat (msec): min=523, max=10679, avg=2647.24, stdev=3451.96 00:18:15.242 lat (msec): min=525, max=12474, avg=2668.04, stdev=3471.43 00:18:15.242 clat percentiles (msec): 00:18:15.242 | 1.00th=[ 527], 5.00th=[ 531], 10.00th=[ 535], 20.00th=[ 535], 00:18:15.242 | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 550], 60.00th=[ 567], 00:18:15.242 | 70.00th=[ 600], 80.00th=[ 8658], 90.00th=[ 8792], 95.00th=[ 8926], 00:18:15.242 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[10671], 99.95th=[10671], 00:18:15.242 | 99.99th=[10671] 00:18:15.242 bw ( KiB/s): min= 2052, max=247808, per=3.93%, avg=108544.57, stdev=108091.59, samples=7 00:18:15.242 iops : min= 2, max= 242, avg=106.00, stdev=105.56, samples=7 00:18:15.243 lat (msec) : 750=70.88%, >=2000=29.12% 00:18:15.243 cpu : usr=0.02%, sys=1.31%, ctx=405, majf=0, minf=32769 00:18:15.243 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.4%, >=64=87.3% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.243 issued rwts: total=498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job2: (groupid=0, jobs=1): err= 0: pid=3049084: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=6, BW=6235KiB/s (6385kB/s)(77.0MiB/12646msec) 00:18:15.243 slat (usec): min=969, max=2098.8k, avg=136770.70, stdev=493055.03 00:18:15.243 clat (msec): min=2113, max=12644, avg=10835.49, stdev=2781.93 00:18:15.243 lat (msec): min=4196, max=12645, avg=10972.26, stdev=2600.46 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 2106], 5.00th=[ 4279], 10.00th=[ 6342], 20.00th=[ 8490], 00:18:15.243 | 30.00th=[10671], 40.00th=[12416], 50.00th=[12550], 60.00th=[12550], 00:18:15.243 | 70.00th=[12550], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:18:15.243 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:18:15.243 | 99.99th=[12684] 00:18:15.243 lat (msec) : >=2000=100.00% 00:18:15.243 cpu : usr=0.00%, sys=0.63%, ctx=98, majf=0, minf=19713 00:18:15.243 IO depths : 1=1.3%, 2=2.6%, 4=5.2%, 8=10.4%, 16=20.8%, 32=41.6%, >=64=18.2% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.243 issued rwts: total=77,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job2: (groupid=0, jobs=1): err= 0: pid=3049085: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=1, BW=1631KiB/s (1670kB/s)(20.0MiB/12555msec) 00:18:15.243 slat (msec): min=4, max=2118, avg=522.00, stdev=893.74 00:18:15.243 clat (msec): min=2114, max=12549, avg=7681.44, stdev=2789.35 00:18:15.243 lat (msec): min=4232, max=12554, avg=8203.44, stdev=2666.89 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 4245], 20.00th=[ 4279], 00:18:15.243 | 30.00th=[ 6342], 40.00th=[ 6409], 50.00th=[ 8557], 60.00th=[ 8557], 00:18:15.243 | 70.00th=[ 8658], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:18:15.243 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.243 | 99.99th=[12550] 00:18:15.243 lat (msec) : >=2000=100.00% 00:18:15.243 cpu : usr=0.01%, sys=0.12%, ctx=46, majf=0, minf=5121 00:18:15.243 IO depths : 1=5.0%, 2=10.0%, 4=20.0%, 8=40.0%, 16=25.0%, 32=0.0%, >=64=0.0% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.243 issued rwts: total=20,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job2: (groupid=0, jobs=1): err= 0: pid=3049086: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=38, BW=39.0MiB/s (40.9MB/s)(492MiB/12616msec) 00:18:15.243 slat (usec): min=62, max=2150.1k, avg=21339.52, stdev=164915.54 00:18:15.243 clat (msec): min=513, max=12391, avg=2830.44, stdev=2935.22 00:18:15.243 lat (msec): min=515, max=12530, avg=2851.78, stdev=2957.09 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 518], 5.00th=[ 535], 10.00th=[ 550], 20.00th=[ 567], 00:18:15.243 | 30.00th=[ 617], 40.00th=[ 877], 50.00th=[ 1586], 60.00th=[ 1703], 00:18:15.243 | 70.00th=[ 2366], 80.00th=[ 7416], 90.00th=[ 7752], 95.00th=[ 7953], 00:18:15.243 | 99.00th=[ 8087], 99.50th=[ 8557], 99.90th=[12416], 99.95th=[12416], 00:18:15.243 | 99.99th=[12416] 00:18:15.243 bw ( KiB/s): min= 2048, max=247808, per=3.01%, avg=83092.33, stdev=81575.41, samples=9 00:18:15.243 iops : min= 2, max= 242, avg=81.00, stdev=79.58, samples=9 00:18:15.243 lat (msec) : 750=31.30%, 1000=11.59%, 2000=25.00%, >=2000=32.11% 00:18:15.243 cpu : usr=0.00%, sys=1.13%, ctx=586, majf=0, minf=32769 00:18:15.243 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=6.5%, >=64=87.2% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.243 issued rwts: total=492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job2: (groupid=0, jobs=1): err= 0: pid=3049087: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=26, BW=26.1MiB/s (27.4MB/s)(272MiB/10424msec) 00:18:15.243 slat (usec): min=76, max=2066.9k, avg=38095.51, stdev=236529.93 00:18:15.243 clat (msec): min=59, max=5739, avg=1695.38, stdev=939.30 00:18:15.243 lat (msec): min=643, max=7583, avg=1733.48, stdev=997.69 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 642], 5.00th=[ 651], 10.00th=[ 676], 20.00th=[ 701], 00:18:15.243 | 30.00th=[ 793], 40.00th=[ 1133], 50.00th=[ 1519], 60.00th=[ 2265], 00:18:15.243 | 70.00th=[ 2400], 80.00th=[ 2500], 90.00th=[ 2635], 95.00th=[ 2735], 00:18:15.243 | 99.00th=[ 5738], 99.50th=[ 5738], 99.90th=[ 5738], 99.95th=[ 5738], 00:18:15.243 | 99.99th=[ 5738] 00:18:15.243 bw ( KiB/s): min=124928, max=169984, per=5.34%, avg=147456.00, stdev=31859.40, samples=2 00:18:15.243 iops : min= 122, max= 166, avg=144.00, stdev=31.11, samples=2 00:18:15.243 lat (msec) : 100=0.37%, 750=25.00%, 1000=11.76%, 2000=14.34%, >=2000=48.53% 00:18:15.243 cpu : usr=0.04%, sys=1.18%, ctx=360, majf=0, minf=32769 00:18:15.243 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.9%, 32=11.8%, >=64=76.8% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:18:15.243 issued rwts: total=272,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job2: (groupid=0, jobs=1): err= 0: pid=3049088: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=2, BW=2124KiB/s (2175kB/s)(26.0MiB/12535msec) 00:18:15.243 slat (usec): min=957, max=2110.5k, avg=400736.14, stdev=817397.39 00:18:15.243 clat (msec): min=2114, max=12531, avg=7848.87, stdev=3142.17 00:18:15.243 lat (msec): min=4225, max=12533, avg=8249.60, stdev=3044.51 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 4279], 00:18:15.243 | 30.00th=[ 6342], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 8557], 00:18:15.243 | 70.00th=[10671], 80.00th=[10671], 90.00th=[12550], 95.00th=[12550], 00:18:15.243 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.243 | 99.99th=[12550] 00:18:15.243 lat (msec) : >=2000=100.00% 00:18:15.243 cpu : usr=0.00%, sys=0.21%, ctx=46, majf=0, minf=6657 00:18:15.243 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:18:15.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.243 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.243 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.243 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.243 job3: (groupid=0, jobs=1): err= 0: pid=3049093: Wed Apr 24 19:25:00 2024 00:18:15.243 read: IOPS=18, BW=18.7MiB/s (19.6MB/s)(233MiB/12490msec) 00:18:15.243 slat (usec): min=48, max=2034.5k, avg=44540.33, stdev=248785.50 00:18:15.243 clat (msec): min=1846, max=7186, avg=4130.32, stdev=1599.27 00:18:15.243 lat (msec): min=1857, max=7193, avg=4174.86, stdev=1605.42 00:18:15.243 clat percentiles (msec): 00:18:15.243 | 1.00th=[ 1871], 5.00th=[ 1972], 10.00th=[ 2056], 20.00th=[ 2140], 00:18:15.243 | 30.00th=[ 3842], 40.00th=[ 3910], 50.00th=[ 4111], 60.00th=[ 4245], 00:18:15.243 | 70.00th=[ 5201], 80.00th=[ 5470], 90.00th=[ 6409], 95.00th=[ 7148], 00:18:15.243 | 99.00th=[ 7215], 99.50th=[ 7215], 99.90th=[ 7215], 99.95th=[ 7215], 00:18:15.243 | 99.99th=[ 7215] 00:18:15.243 bw ( KiB/s): min= 2052, max=96256, per=1.97%, avg=54273.00, stdev=39053.67, samples=4 00:18:15.243 iops : min= 2, max= 94, avg=53.00, stdev=38.14, samples=4 00:18:15.244 lat (msec) : 2000=7.30%, >=2000=92.70% 00:18:15.244 cpu : usr=0.00%, sys=0.89%, ctx=284, majf=0, minf=32769 00:18:15.244 IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.4%, 16=6.9%, 32=13.7%, >=64=73.0% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.9% 00:18:15.244 issued rwts: total=233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049094: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=1, BW=1308KiB/s (1340kB/s)(16.0MiB/12522msec) 00:18:15.244 slat (usec): min=944, max=2107.9k, avg=651114.01, stdev=969815.15 00:18:15.244 clat (msec): min=2103, max=12520, avg=9325.81, stdev=3631.98 00:18:15.244 lat (msec): min=4190, max=12521, avg=9976.92, stdev=3153.22 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 2106], 5.00th=[ 2106], 10.00th=[ 4178], 20.00th=[ 6342], 00:18:15.244 | 30.00th=[ 6409], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[12550], 00:18:15.244 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.244 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.244 | 99.99th=[12550] 00:18:15.244 lat (msec) : >=2000=100.00% 00:18:15.244 cpu : usr=0.01%, sys=0.10%, ctx=43, majf=0, minf=4097 00:18:15.244 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 issued rwts: total=16,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049095: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=193, BW=193MiB/s (202MB/s)(1933MiB/10014msec) 00:18:15.244 slat (usec): min=38, max=2031.4k, avg=5169.21, stdev=75863.95 00:18:15.244 clat (msec): min=13, max=6536, avg=280.21, stdev=447.29 00:18:15.244 lat (msec): min=14, max=6537, avg=285.38, stdev=469.65 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 32], 5.00th=[ 105], 10.00th=[ 121], 20.00th=[ 121], 00:18:15.244 | 30.00th=[ 122], 40.00th=[ 123], 50.00th=[ 234], 60.00th=[ 266], 00:18:15.244 | 70.00th=[ 388], 80.00th=[ 401], 90.00th=[ 418], 95.00th=[ 451], 00:18:15.244 | 99.00th=[ 514], 99.50th=[ 4665], 99.90th=[ 6544], 99.95th=[ 6544], 00:18:15.244 | 99.99th=[ 6544] 00:18:15.244 bw ( KiB/s): min=294912, max=876544, per=15.94%, avg=439814.33, stdev=225491.83, samples=6 00:18:15.244 iops : min= 288, max= 856, avg=429.50, stdev=220.21, samples=6 00:18:15.244 lat (msec) : 20=0.41%, 50=1.66%, 100=2.69%, 250=45.99%, 500=47.75% 00:18:15.244 lat (msec) : 750=0.57%, >=2000=0.93% 00:18:15.244 cpu : usr=0.07%, sys=2.45%, ctx=1724, majf=0, minf=32769 00:18:15.244 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.8%, 32=1.7%, >=64=96.7% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.244 issued rwts: total=1933,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049096: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=38, BW=38.5MiB/s (40.4MB/s)(403MiB/10470msec) 00:18:15.244 slat (usec): min=66, max=2029.1k, avg=25752.65, stdev=188684.32 00:18:15.244 clat (msec): min=86, max=6922, avg=1571.67, stdev=1323.02 00:18:15.244 lat (msec): min=638, max=6933, avg=1597.42, stdev=1346.57 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 642], 5.00th=[ 667], 10.00th=[ 676], 20.00th=[ 709], 00:18:15.244 | 30.00th=[ 751], 40.00th=[ 810], 50.00th=[ 852], 60.00th=[ 927], 00:18:15.244 | 70.00th=[ 2198], 80.00th=[ 2433], 90.00th=[ 2601], 95.00th=[ 3037], 00:18:15.244 | 99.00th=[ 6879], 99.50th=[ 6879], 99.90th=[ 6946], 99.95th=[ 6946], 00:18:15.244 | 99.99th=[ 6946] 00:18:15.244 bw ( KiB/s): min= 2048, max=188416, per=4.08%, avg=112573.60, stdev=84027.87, samples=5 00:18:15.244 iops : min= 2, max= 184, avg=109.80, stdev=81.95, samples=5 00:18:15.244 lat (msec) : 100=0.25%, 750=29.78%, 1000=32.01%, 2000=1.24%, >=2000=36.72% 00:18:15.244 cpu : usr=0.05%, sys=1.61%, ctx=368, majf=0, minf=32769 00:18:15.244 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=7.9%, >=64=84.4% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:15.244 issued rwts: total=403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049097: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=15, BW=15.5MiB/s (16.3MB/s)(194MiB/12481msec) 00:18:15.244 slat (usec): min=672, max=2119.8k, avg=53456.82, stdev=298258.64 00:18:15.244 clat (msec): min=791, max=11747, avg=7728.47, stdev=4767.33 00:18:15.244 lat (msec): min=796, max=11750, avg=7781.92, stdev=4753.68 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 793], 5.00th=[ 818], 10.00th=[ 844], 20.00th=[ 961], 00:18:15.244 | 30.00th=[ 2106], 40.00th=[10671], 50.00th=[11073], 60.00th=[11208], 00:18:15.244 | 70.00th=[11342], 80.00th=[11476], 90.00th=[11610], 95.00th=[11745], 00:18:15.244 | 99.00th=[11745], 99.50th=[11745], 99.90th=[11745], 99.95th=[11745], 00:18:15.244 | 99.99th=[11745] 00:18:15.244 bw ( KiB/s): min= 2048, max=112640, per=0.71%, avg=19602.86, stdev=41059.56, samples=7 00:18:15.244 iops : min= 2, max= 110, avg=19.14, stdev=40.10, samples=7 00:18:15.244 lat (msec) : 1000=22.16%, 2000=7.73%, >=2000=70.10% 00:18:15.244 cpu : usr=0.00%, sys=0.93%, ctx=416, majf=0, minf=32769 00:18:15.244 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.1%, 16=8.2%, 32=16.5%, >=64=67.5% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:18:15.244 issued rwts: total=194,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049098: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=7, BW=7223KiB/s (7397kB/s)(89.0MiB/12617msec) 00:18:15.244 slat (usec): min=897, max=2087.6k, avg=118111.33, stdev=457706.48 00:18:15.244 clat (msec): min=2103, max=12614, avg=10404.54, stdev=3000.33 00:18:15.244 lat (msec): min=4174, max=12616, avg=10522.65, stdev=2874.10 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 2106], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[ 6409], 00:18:15.244 | 30.00th=[10671], 40.00th=[10671], 50.00th=[12416], 60.00th=[12550], 00:18:15.244 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.244 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.244 | 99.99th=[12550] 00:18:15.244 lat (msec) : >=2000=100.00% 00:18:15.244 cpu : usr=0.02%, sys=0.71%, ctx=108, majf=0, minf=22785 00:18:15.244 IO depths : 1=1.1%, 2=2.2%, 4=4.5%, 8=9.0%, 16=18.0%, 32=36.0%, >=64=29.2% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.244 issued rwts: total=89,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049099: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=0, BW=736KiB/s (754kB/s)(9216KiB/12514msec) 00:18:15.244 slat (msec): min=21, max=2123, avg=1155.27, stdev=1069.34 00:18:15.244 clat (msec): min=2115, max=10681, avg=6861.89, stdev=2976.10 00:18:15.244 lat (msec): min=4238, max=12513, avg=8017.15, stdev=2920.91 00:18:15.244 clat percentiles (msec): 00:18:15.244 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 2123], 20.00th=[ 4245], 00:18:15.244 | 30.00th=[ 4279], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 8490], 00:18:15.244 | 70.00th=[ 8557], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:18:15.244 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:18:15.244 | 99.99th=[10671] 00:18:15.244 lat (msec) : >=2000=100.00% 00:18:15.244 cpu : usr=0.00%, sys=0.07%, ctx=44, majf=0, minf=2305 00:18:15.244 IO depths : 1=11.1%, 2=22.2%, 4=44.4%, 8=22.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:15.244 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.244 issued rwts: total=9,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.244 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.244 job3: (groupid=0, jobs=1): err= 0: pid=3049100: Wed Apr 24 19:25:00 2024 00:18:15.244 read: IOPS=1, BW=1470KiB/s (1506kB/s)(18.0MiB/12536msec) 00:18:15.244 slat (usec): min=936, max=2137.2k, avg=578864.71, stdev=935763.56 00:18:15.244 clat (msec): min=2115, max=12533, avg=9589.32, stdev=3507.50 00:18:15.244 lat (msec): min=4193, max=12535, avg=10168.19, stdev=3028.59 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 4178], 20.00th=[ 6342], 00:18:15.245 | 30.00th=[ 8490], 40.00th=[10671], 50.00th=[10671], 60.00th=[12550], 00:18:15.245 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.245 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.245 | 99.99th=[12550] 00:18:15.245 lat (msec) : >=2000=100.00% 00:18:15.245 cpu : usr=0.00%, sys=0.14%, ctx=45, majf=0, minf=4609 00:18:15.245 IO depths : 1=5.6%, 2=11.1%, 4=22.2%, 8=44.4%, 16=16.7%, 32=0.0%, >=64=0.0% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.245 issued rwts: total=18,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job3: (groupid=0, jobs=1): err= 0: pid=3049101: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=2, BW=2715KiB/s (2780kB/s)(33.0MiB/12448msec) 00:18:15.245 slat (usec): min=880, max=2082.5k, avg=313221.01, stdev=717267.55 00:18:15.245 clat (msec): min=2111, max=12324, avg=8312.67, stdev=2799.17 00:18:15.245 lat (msec): min=4159, max=12447, avg=8625.89, stdev=2658.32 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 2106], 5.00th=[ 4144], 10.00th=[ 4178], 20.00th=[ 6342], 00:18:15.245 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[ 8557], 00:18:15.245 | 70.00th=[10671], 80.00th=[10671], 90.00th=[12281], 95.00th=[12281], 00:18:15.245 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:15.245 | 99.99th=[12281] 00:18:15.245 lat (msec) : >=2000=100.00% 00:18:15.245 cpu : usr=0.02%, sys=0.22%, ctx=58, majf=0, minf=8449 00:18:15.245 IO depths : 1=3.0%, 2=6.1%, 4=12.1%, 8=24.2%, 16=48.5%, 32=6.1%, >=64=0.0% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.245 issued rwts: total=33,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job3: (groupid=0, jobs=1): err= 0: pid=3049102: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=15, BW=15.3MiB/s (16.0MB/s)(193MiB/12617msec) 00:18:15.245 slat (usec): min=97, max=2078.2k, avg=54471.28, stdev=273788.80 00:18:15.245 clat (msec): min=2102, max=12451, avg=6637.16, stdev=1812.69 00:18:15.245 lat (msec): min=4180, max=12540, avg=6691.63, stdev=1828.81 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 4178], 5.00th=[ 5000], 10.00th=[ 5067], 20.00th=[ 5201], 00:18:15.245 | 30.00th=[ 5470], 40.00th=[ 5805], 50.00th=[ 6141], 60.00th=[ 7080], 00:18:15.245 | 70.00th=[ 7215], 80.00th=[ 7416], 90.00th=[ 8490], 95.00th=[12013], 00:18:15.245 | 99.00th=[12416], 99.50th=[12416], 99.90th=[12416], 99.95th=[12416], 00:18:15.245 | 99.99th=[12416] 00:18:15.245 bw ( KiB/s): min= 1882, max=69632, per=1.22%, avg=33750.50, stdev=35776.90, samples=4 00:18:15.245 iops : min= 1, max= 68, avg=32.75, stdev=35.19, samples=4 00:18:15.245 lat (msec) : >=2000=100.00% 00:18:15.245 cpu : usr=0.02%, sys=1.03%, ctx=367, majf=0, minf=32769 00:18:15.245 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.1%, 16=8.3%, 32=16.6%, >=64=67.4% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:18:15.245 issued rwts: total=193,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job3: (groupid=0, jobs=1): err= 0: pid=3049103: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=70, BW=70.1MiB/s (73.6MB/s)(874MiB/12460msec) 00:18:15.245 slat (usec): min=55, max=2126.4k, avg=11841.26, stdev=121139.55 00:18:15.245 clat (msec): min=495, max=9006, avg=1761.22, stdev=2755.13 00:18:15.245 lat (msec): min=497, max=9006, avg=1773.06, stdev=2764.42 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 502], 5.00th=[ 531], 10.00th=[ 542], 20.00th=[ 550], 00:18:15.245 | 30.00th=[ 567], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 592], 00:18:15.245 | 70.00th=[ 617], 80.00th=[ 659], 90.00th=[ 8658], 95.00th=[ 8792], 00:18:15.245 | 99.00th=[ 8926], 99.50th=[ 8926], 99.90th=[ 9060], 99.95th=[ 9060], 00:18:15.245 | 99.99th=[ 9060] 00:18:15.245 bw ( KiB/s): min= 2052, max=241664, per=5.54%, avg=152986.00, stdev=99190.81, samples=10 00:18:15.245 iops : min= 2, max= 236, avg=149.40, stdev=96.87, samples=10 00:18:15.245 lat (msec) : 500=0.92%, 750=82.15%, >=2000=16.93% 00:18:15.245 cpu : usr=0.01%, sys=1.57%, ctx=769, majf=0, minf=32769 00:18:15.245 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.7%, >=64=92.8% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.245 issued rwts: total=874,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job3: (groupid=0, jobs=1): err= 0: pid=3049104: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=22, BW=22.2MiB/s (23.3MB/s)(279MiB/12573msec) 00:18:15.245 slat (usec): min=42, max=2082.5k, avg=37362.57, stdev=243090.45 00:18:15.245 clat (msec): min=2114, max=10278, avg=5000.12, stdev=2467.35 00:18:15.245 lat (msec): min=2115, max=10329, avg=5037.49, stdev=2479.40 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 2165], 20.00th=[ 2232], 00:18:15.245 | 30.00th=[ 4010], 40.00th=[ 4077], 50.00th=[ 4144], 60.00th=[ 4396], 00:18:15.245 | 70.00th=[ 8221], 80.00th=[ 8288], 90.00th=[ 8356], 95.00th=[ 8356], 00:18:15.245 | 99.00th=[ 8423], 99.50th=[ 8557], 99.90th=[10268], 99.95th=[10268], 00:18:15.245 | 99.99th=[10268] 00:18:15.245 bw ( KiB/s): min= 2027, max=233472, per=2.26%, avg=62239.40, stdev=96781.12, samples=5 00:18:15.245 iops : min= 1, max= 228, avg=60.40, stdev=94.72, samples=5 00:18:15.245 lat (msec) : >=2000=100.00% 00:18:15.245 cpu : usr=0.00%, sys=1.00%, ctx=226, majf=0, minf=32769 00:18:15.245 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.9%, 16=5.7%, 32=11.5%, >=64=77.4% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:18:15.245 issued rwts: total=279,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job3: (groupid=0, jobs=1): err= 0: pid=3049105: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=28, BW=28.8MiB/s (30.2MB/s)(362MiB/12562msec) 00:18:15.245 slat (usec): min=64, max=2143.9k, avg=28885.80, stdev=217374.85 00:18:15.245 clat (msec): min=316, max=10970, avg=4192.71, stdev=4559.30 00:18:15.245 lat (msec): min=320, max=10971, avg=4221.60, stdev=4568.62 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 321], 5.00th=[ 342], 10.00th=[ 376], 20.00th=[ 498], 00:18:15.245 | 30.00th=[ 642], 40.00th=[ 776], 50.00th=[ 953], 60.00th=[ 2534], 00:18:15.245 | 70.00th=[ 8490], 80.00th=[10805], 90.00th=[10939], 95.00th=[10939], 00:18:15.245 | 99.00th=[10939], 99.50th=[10939], 99.90th=[10939], 99.95th=[10939], 00:18:15.245 | 99.99th=[10939] 00:18:15.245 bw ( KiB/s): min= 1505, max=274432, per=2.90%, avg=80119.33, stdev=111768.39, samples=6 00:18:15.245 iops : min= 1, max= 268, avg=78.00, stdev=109.34, samples=6 00:18:15.245 lat (msec) : 500=20.17%, 750=17.40%, 1000=15.75%, 2000=4.97%, >=2000=41.71% 00:18:15.245 cpu : usr=0.02%, sys=1.04%, ctx=540, majf=0, minf=32769 00:18:15.245 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.2%, 16=4.4%, 32=8.8%, >=64=82.6% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:15.245 issued rwts: total=362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job4: (groupid=0, jobs=1): err= 0: pid=3049118: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=6, BW=6271KiB/s (6422kB/s)(64.0MiB/10450msec) 00:18:15.245 slat (usec): min=917, max=2069.2k, avg=161242.99, stdev=530515.14 00:18:15.245 clat (msec): min=129, max=10445, avg=6799.53, stdev=3079.10 00:18:15.245 lat (msec): min=2150, max=10448, avg=6960.77, stdev=2993.26 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 130], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 4329], 00:18:15.245 | 30.00th=[ 4396], 40.00th=[ 6477], 50.00th=[ 6544], 60.00th=[ 8658], 00:18:15.245 | 70.00th=[ 8658], 80.00th=[10402], 90.00th=[10402], 95.00th=[10402], 00:18:15.245 | 99.00th=[10402], 99.50th=[10402], 99.90th=[10402], 99.95th=[10402], 00:18:15.245 | 99.99th=[10402] 00:18:15.245 lat (msec) : 250=1.56%, >=2000=98.44% 00:18:15.245 cpu : usr=0.01%, sys=0.59%, ctx=70, majf=0, minf=16385 00:18:15.245 IO depths : 1=1.6%, 2=3.1%, 4=6.2%, 8=12.5%, 16=25.0%, 32=50.0%, >=64=1.6% 00:18:15.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.245 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.245 issued rwts: total=64,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.245 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.245 job4: (groupid=0, jobs=1): err= 0: pid=3049119: Wed Apr 24 19:25:00 2024 00:18:15.245 read: IOPS=2, BW=2796KiB/s (2863kB/s)(34.0MiB/12452msec) 00:18:15.245 slat (usec): min=1000, max=2078.1k, avg=304301.41, stdev=712374.21 00:18:15.245 clat (msec): min=2105, max=12450, avg=9423.21, stdev=3282.71 00:18:15.245 lat (msec): min=4183, max=12451, avg=9727.52, stdev=3055.47 00:18:15.245 clat percentiles (msec): 00:18:15.245 | 1.00th=[ 2106], 5.00th=[ 4178], 10.00th=[ 4245], 20.00th=[ 6342], 00:18:15.245 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[12416], 00:18:15.245 | 70.00th=[12416], 80.00th=[12416], 90.00th=[12416], 95.00th=[12416], 00:18:15.245 | 99.00th=[12416], 99.50th=[12416], 99.90th=[12416], 99.95th=[12416], 00:18:15.245 | 99.99th=[12416] 00:18:15.245 lat (msec) : >=2000=100.00% 00:18:15.245 cpu : usr=0.01%, sys=0.27%, ctx=68, majf=0, minf=8705 00:18:15.246 IO depths : 1=2.9%, 2=5.9%, 4=11.8%, 8=23.5%, 16=47.1%, 32=8.8%, >=64=0.0% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.246 issued rwts: total=34,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049120: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=36, BW=36.6MiB/s (38.3MB/s)(460MiB/12581msec) 00:18:15.246 slat (usec): min=71, max=2088.6k, avg=22767.13, stdev=173836.37 00:18:15.246 clat (msec): min=569, max=10632, avg=3368.22, stdev=2970.60 00:18:15.246 lat (msec): min=571, max=10650, avg=3390.99, stdev=2986.45 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 567], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 592], 00:18:15.246 | 30.00th=[ 634], 40.00th=[ 818], 50.00th=[ 3205], 60.00th=[ 3272], 00:18:15.246 | 70.00th=[ 3406], 80.00th=[ 7684], 90.00th=[ 7953], 95.00th=[ 8154], 00:18:15.246 | 99.00th=[ 8490], 99.50th=[10537], 99.90th=[10671], 99.95th=[10671], 00:18:15.246 | 99.99th=[10671] 00:18:15.246 bw ( KiB/s): min= 1992, max=223232, per=2.74%, avg=75736.11, stdev=80899.37, samples=9 00:18:15.246 iops : min= 1, max= 218, avg=73.78, stdev=79.03, samples=9 00:18:15.246 lat (msec) : 750=37.17%, 1000=5.43%, 2000=1.74%, >=2000=55.65% 00:18:15.246 cpu : usr=0.02%, sys=1.10%, ctx=561, majf=0, minf=32769 00:18:15.246 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.5%, 32=7.0%, >=64=86.3% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.246 issued rwts: total=460,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049121: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=29, BW=29.9MiB/s (31.4MB/s)(316MiB/10562msec) 00:18:15.246 slat (usec): min=463, max=2044.8k, avg=33056.79, stdev=227877.99 00:18:15.246 clat (msec): min=113, max=9132, avg=4033.54, stdev=3721.80 00:18:15.246 lat (msec): min=594, max=9138, avg=4066.60, stdev=3722.77 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 592], 5.00th=[ 617], 10.00th=[ 667], 20.00th=[ 743], 00:18:15.246 | 30.00th=[ 835], 40.00th=[ 978], 50.00th=[ 1099], 60.00th=[ 4799], 00:18:15.246 | 70.00th=[ 8658], 80.00th=[ 8792], 90.00th=[ 9060], 95.00th=[ 9060], 00:18:15.246 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[ 9194], 99.95th=[ 9194], 00:18:15.246 | 99.99th=[ 9194] 00:18:15.246 bw ( KiB/s): min= 2039, max=182272, per=2.34%, avg=64506.33, stdev=82949.77, samples=6 00:18:15.246 iops : min= 1, max= 178, avg=62.67, stdev=81.28, samples=6 00:18:15.246 lat (msec) : 250=0.32%, 750=20.57%, 1000=23.42%, 2000=8.86%, >=2000=46.84% 00:18:15.246 cpu : usr=0.00%, sys=1.11%, ctx=583, majf=0, minf=32769 00:18:15.246 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.5%, 16=5.1%, 32=10.1%, >=64=80.1% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:18:15.246 issued rwts: total=316,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049123: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=183, BW=184MiB/s (193MB/s)(2288MiB/12444msec) 00:18:15.246 slat (usec): min=42, max=2176.2k, avg=4508.62, stdev=56657.18 00:18:15.246 clat (msec): min=116, max=4506, avg=593.38, stdev=971.82 00:18:15.246 lat (msec): min=117, max=4635, avg=597.89, stdev=976.85 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 117], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 120], 00:18:15.246 | 30.00th=[ 121], 40.00th=[ 241], 50.00th=[ 305], 60.00th=[ 401], 00:18:15.246 | 70.00th=[ 531], 80.00th=[ 642], 90.00th=[ 869], 95.00th=[ 4329], 00:18:15.246 | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4530], 00:18:15.246 | 99.99th=[ 4530] 00:18:15.246 bw ( KiB/s): min= 2052, max=1097728, per=11.46%, avg=316103.50, stdev=290243.10, samples=14 00:18:15.246 iops : min= 2, max= 1072, avg=308.64, stdev=283.47, samples=14 00:18:15.246 lat (msec) : 250=40.78%, 500=25.61%, 750=20.10%, 1000=6.82%, >=2000=6.69% 00:18:15.246 cpu : usr=0.06%, sys=2.05%, ctx=2502, majf=0, minf=32769 00:18:15.246 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.3%, 16=0.7%, 32=1.4%, >=64=97.2% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.246 issued rwts: total=2288,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049124: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=38, BW=38.9MiB/s (40.8MB/s)(408MiB/10492msec) 00:18:15.246 slat (usec): min=109, max=2032.5k, avg=25498.38, stdev=193742.98 00:18:15.246 clat (msec): min=87, max=5350, avg=2651.32, stdev=909.67 00:18:15.246 lat (msec): min=983, max=5352, avg=2676.82, stdev=912.25 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 1028], 5.00th=[ 1972], 10.00th=[ 1989], 20.00th=[ 2039], 00:18:15.246 | 30.00th=[ 2072], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], 00:18:15.246 | 70.00th=[ 3440], 80.00th=[ 3742], 90.00th=[ 4044], 95.00th=[ 4144], 00:18:15.246 | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 5336], 99.95th=[ 5336], 00:18:15.246 | 99.99th=[ 5336] 00:18:15.246 bw ( KiB/s): min= 2048, max=231424, per=2.97%, avg=81854.57, stdev=103776.02, samples=7 00:18:15.246 iops : min= 2, max= 226, avg=79.86, stdev=101.21, samples=7 00:18:15.246 lat (msec) : 100=0.25%, 1000=0.49%, 2000=10.54%, >=2000=88.73% 00:18:15.246 cpu : usr=0.00%, sys=0.94%, ctx=453, majf=0, minf=32769 00:18:15.246 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=3.9%, 32=7.8%, >=64=84.6% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:15.246 issued rwts: total=408,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049125: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=8, BW=8659KiB/s (8867kB/s)(89.0MiB/10525msec) 00:18:15.246 slat (usec): min=758, max=2026.9k, avg=116971.20, stdev=450147.76 00:18:15.246 clat (msec): min=113, max=10521, avg=6812.21, stdev=2879.45 00:18:15.246 lat (msec): min=2140, max=10524, avg=6929.18, stdev=2814.96 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 114], 5.00th=[ 2198], 10.00th=[ 2232], 20.00th=[ 4329], 00:18:15.246 | 30.00th=[ 6409], 40.00th=[ 6544], 50.00th=[ 6544], 60.00th=[ 6611], 00:18:15.246 | 70.00th=[ 8658], 80.00th=[10402], 90.00th=[10537], 95.00th=[10537], 00:18:15.246 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:18:15.246 | 99.99th=[10537] 00:18:15.246 lat (msec) : 250=1.12%, >=2000=98.88% 00:18:15.246 cpu : usr=0.00%, sys=0.79%, ctx=81, majf=0, minf=22785 00:18:15.246 IO depths : 1=1.1%, 2=2.2%, 4=4.5%, 8=9.0%, 16=18.0%, 32=36.0%, >=64=29.2% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.246 issued rwts: total=89,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049126: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=3, BW=3271KiB/s (3350kB/s)(40.0MiB/12521msec) 00:18:15.246 slat (usec): min=900, max=2105.8k, avg=260376.66, stdev=672309.65 00:18:15.246 clat (msec): min=2105, max=12518, avg=9039.35, stdev=3428.21 00:18:15.246 lat (msec): min=4154, max=12520, avg=9299.73, stdev=3280.39 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 2106], 5.00th=[ 4144], 10.00th=[ 4178], 20.00th=[ 4279], 00:18:15.246 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[10671], 00:18:15.246 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12550], 00:18:15.246 | 99.00th=[12550], 99.50th=[12550], 99.90th=[12550], 99.95th=[12550], 00:18:15.246 | 99.99th=[12550] 00:18:15.246 lat (msec) : >=2000=100.00% 00:18:15.246 cpu : usr=0.00%, sys=0.30%, ctx=70, majf=0, minf=10241 00:18:15.246 IO depths : 1=2.5%, 2=5.0%, 4=10.0%, 8=20.0%, 16=40.0%, 32=22.5%, >=64=0.0% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:15.246 issued rwts: total=40,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049127: Wed Apr 24 19:25:00 2024 00:18:15.246 read: IOPS=40, BW=40.7MiB/s (42.7MB/s)(510MiB/12528msec) 00:18:15.246 slat (usec): min=48, max=2148.4k, avg=20398.79, stdev=174136.92 00:18:15.246 clat (msec): min=518, max=8581, avg=2258.70, stdev=2615.45 00:18:15.246 lat (msec): min=519, max=10600, avg=2279.09, stdev=2634.67 00:18:15.246 clat percentiles (msec): 00:18:15.246 | 1.00th=[ 523], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], 00:18:15.246 | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], 00:18:15.246 | 70.00th=[ 2702], 80.00th=[ 6477], 90.00th=[ 6678], 95.00th=[ 6812], 00:18:15.246 | 99.00th=[ 6879], 99.50th=[ 8557], 99.90th=[ 8557], 99.95th=[ 8557], 00:18:15.246 | 99.99th=[ 8557] 00:18:15.246 bw ( KiB/s): min= 1505, max=233005, per=4.05%, avg=111846.29, stdev=108526.86, samples=7 00:18:15.246 iops : min= 1, max= 227, avg=109.00, stdev=105.86, samples=7 00:18:15.246 lat (msec) : 750=68.04%, >=2000=31.96% 00:18:15.246 cpu : usr=0.03%, sys=1.25%, ctx=439, majf=0, minf=32769 00:18:15.246 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.6% 00:18:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.246 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.246 issued rwts: total=510,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.246 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.246 job4: (groupid=0, jobs=1): err= 0: pid=3049128: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=2, BW=2056KiB/s (2106kB/s)(25.0MiB/12450msec) 00:18:15.247 slat (msec): min=3, max=2079, avg=413.20, stdev=797.42 00:18:15.247 clat (msec): min=2119, max=12286, avg=7693.45, stdev=2818.23 00:18:15.247 lat (msec): min=4168, max=12449, avg=8106.65, stdev=2722.65 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 4245], 00:18:15.247 | 30.00th=[ 6342], 40.00th=[ 6409], 50.00th=[ 8490], 60.00th=[ 8490], 00:18:15.247 | 70.00th=[ 8557], 80.00th=[10671], 90.00th=[10671], 95.00th=[12281], 00:18:15.247 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:15.247 | 99.99th=[12281] 00:18:15.247 lat (msec) : >=2000=100.00% 00:18:15.247 cpu : usr=0.00%, sys=0.21%, ctx=60, majf=0, minf=6401 00:18:15.247 IO depths : 1=4.0%, 2=8.0%, 4=16.0%, 8=32.0%, 16=40.0%, 32=0.0%, >=64=0.0% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:15.247 issued rwts: total=25,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job4: (groupid=0, jobs=1): err= 0: pid=3049129: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=50, BW=50.0MiB/s (52.4MB/s)(520MiB/10396msec) 00:18:15.247 slat (usec): min=62, max=2043.7k, avg=19818.68, stdev=152483.81 00:18:15.247 clat (msec): min=87, max=6010, avg=1929.47, stdev=1995.50 00:18:15.247 lat (msec): min=537, max=6013, avg=1949.29, stdev=2002.73 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 592], 00:18:15.247 | 30.00th=[ 667], 40.00th=[ 768], 50.00th=[ 827], 60.00th=[ 877], 00:18:15.247 | 70.00th=[ 1871], 80.00th=[ 4245], 90.00th=[ 5671], 95.00th=[ 5873], 00:18:15.247 | 99.00th=[ 5940], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], 00:18:15.247 | 99.99th=[ 6007] 00:18:15.247 bw ( KiB/s): min=22528, max=235520, per=4.85%, avg=133748.83, stdev=85237.37, samples=6 00:18:15.247 iops : min= 22, max= 230, avg=130.50, stdev=83.20, samples=6 00:18:15.247 lat (msec) : 100=0.19%, 750=38.85%, 1000=26.54%, 2000=6.15%, >=2000=28.27% 00:18:15.247 cpu : usr=0.02%, sys=0.98%, ctx=762, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.2%, >=64=87.9% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.247 issued rwts: total=520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job4: (groupid=0, jobs=1): err= 0: pid=3049130: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=33, BW=33.2MiB/s (34.8MB/s)(416MiB/12547msec) 00:18:15.247 slat (usec): min=442, max=2172.0k, avg=25060.84, stdev=194037.81 00:18:15.247 clat (msec): min=526, max=10637, avg=2715.14, stdev=2765.05 00:18:15.247 lat (msec): min=532, max=10679, avg=2740.20, stdev=2784.90 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 550], 20.00th=[ 592], 00:18:15.247 | 30.00th=[ 667], 40.00th=[ 709], 50.00th=[ 776], 60.00th=[ 827], 00:18:15.247 | 70.00th=[ 6208], 80.00th=[ 6477], 90.00th=[ 6678], 95.00th=[ 6812], 00:18:15.247 | 99.00th=[ 6879], 99.50th=[ 8423], 99.90th=[10671], 99.95th=[10671], 00:18:15.247 | 99.99th=[10671] 00:18:15.247 bw ( KiB/s): min= 1505, max=233472, per=3.57%, avg=98468.00, stdev=96214.41, samples=6 00:18:15.247 iops : min= 1, max= 228, avg=95.67, stdev=94.19, samples=6 00:18:15.247 lat (msec) : 750=44.47%, 1000=18.99%, >=2000=36.54% 00:18:15.247 cpu : usr=0.00%, sys=0.84%, ctx=793, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.7%, >=64=84.9% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.247 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job4: (groupid=0, jobs=1): err= 0: pid=3049131: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=28, BW=28.4MiB/s (29.7MB/s)(298MiB/10508msec) 00:18:15.247 slat (usec): min=399, max=2064.3k, avg=34871.38, stdev=236642.36 00:18:15.247 clat (msec): min=113, max=9237, avg=4247.56, stdev=3932.54 00:18:15.247 lat (msec): min=677, max=9253, avg=4282.43, stdev=3932.35 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 676], 5.00th=[ 693], 10.00th=[ 701], 20.00th=[ 751], 00:18:15.247 | 30.00th=[ 802], 40.00th=[ 827], 50.00th=[ 852], 60.00th=[ 7013], 00:18:15.247 | 70.00th=[ 8792], 80.00th=[ 8926], 90.00th=[ 9060], 95.00th=[ 9194], 00:18:15.247 | 99.00th=[ 9194], 99.50th=[ 9194], 99.90th=[ 9194], 99.95th=[ 9194], 00:18:15.247 | 99.99th=[ 9194] 00:18:15.247 bw ( KiB/s): min= 2048, max=178176, per=1.80%, avg=49735.29, stdev=73603.21, samples=7 00:18:15.247 iops : min= 2, max= 174, avg=48.43, stdev=71.98, samples=7 00:18:15.247 lat (msec) : 250=0.34%, 750=18.46%, 1000=34.90%, >=2000=46.31% 00:18:15.247 cpu : usr=0.02%, sys=1.07%, ctx=552, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.7%, 16=5.4%, 32=10.7%, >=64=78.9% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:18:15.247 issued rwts: total=298,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job5: (groupid=0, jobs=1): err= 0: pid=3049139: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=45, BW=45.4MiB/s (47.6MB/s)(480MiB/10578msec) 00:18:15.247 slat (usec): min=79, max=2024.9k, avg=21752.26, stdev=155440.23 00:18:15.247 clat (msec): min=133, max=8514, avg=2724.74, stdev=1522.61 00:18:15.247 lat (msec): min=558, max=8514, avg=2746.49, stdev=1533.34 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 558], 5.00th=[ 1020], 10.00th=[ 1028], 20.00th=[ 1053], 00:18:15.247 | 30.00th=[ 1318], 40.00th=[ 1854], 50.00th=[ 2869], 60.00th=[ 3608], 00:18:15.247 | 70.00th=[ 3910], 80.00th=[ 4077], 90.00th=[ 4597], 95.00th=[ 4799], 00:18:15.247 | 99.00th=[ 6544], 99.50th=[ 8490], 99.90th=[ 8490], 99.95th=[ 8490], 00:18:15.247 | 99.99th=[ 8490] 00:18:15.247 bw ( KiB/s): min= 1957, max=118546, per=2.38%, avg=65692.27, stdev=44028.02, samples=11 00:18:15.247 iops : min= 1, max= 115, avg=64.00, stdev=43.04, samples=11 00:18:15.247 lat (msec) : 250=0.21%, 750=0.83%, 1000=3.54%, 2000=42.08%, >=2000=53.33% 00:18:15.247 cpu : usr=0.00%, sys=1.62%, ctx=691, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.7%, >=64=86.9% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:15.247 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job5: (groupid=0, jobs=1): err= 0: pid=3049140: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=25, BW=26.0MiB/s (27.2MB/s)(272MiB/10468msec) 00:18:15.247 slat (usec): min=438, max=2131.5k, avg=37984.99, stdev=235989.04 00:18:15.247 clat (msec): min=133, max=5420, avg=3057.19, stdev=1827.63 00:18:15.247 lat (msec): min=1100, max=5424, avg=3095.17, stdev=1820.15 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 1099], 5.00th=[ 1116], 10.00th=[ 1133], 20.00th=[ 1167], 00:18:15.247 | 30.00th=[ 1167], 40.00th=[ 1183], 50.00th=[ 3171], 60.00th=[ 4530], 00:18:15.247 | 70.00th=[ 4799], 80.00th=[ 4933], 90.00th=[ 5201], 95.00th=[ 5269], 00:18:15.247 | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], 00:18:15.247 | 99.99th=[ 5403] 00:18:15.247 bw ( KiB/s): min=10240, max=114688, per=2.14%, avg=58970.00, stdev=48827.05, samples=5 00:18:15.247 iops : min= 10, max= 112, avg=57.40, stdev=47.82, samples=5 00:18:15.247 lat (msec) : 250=0.37%, 2000=45.22%, >=2000=54.41% 00:18:15.247 cpu : usr=0.01%, sys=0.96%, ctx=492, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.9%, 32=11.8%, >=64=76.8% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:18:15.247 issued rwts: total=272,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job5: (groupid=0, jobs=1): err= 0: pid=3049141: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=26, BW=26.2MiB/s (27.4MB/s)(274MiB/10476msec) 00:18:15.247 slat (usec): min=48, max=2047.1k, avg=37733.08, stdev=244140.24 00:18:15.247 clat (msec): min=135, max=10474, avg=4666.39, stdev=3656.41 00:18:15.247 lat (msec): min=394, max=10475, avg=4704.13, stdev=3656.48 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 397], 5.00th=[ 464], 10.00th=[ 489], 20.00th=[ 531], 00:18:15.247 | 30.00th=[ 1250], 40.00th=[ 3406], 50.00th=[ 3473], 60.00th=[ 6342], 00:18:15.247 | 70.00th=[ 7550], 80.00th=[ 9597], 90.00th=[ 9597], 95.00th=[ 9731], 00:18:15.247 | 99.00th=[ 9731], 99.50th=[10402], 99.90th=[10537], 99.95th=[10537], 00:18:15.247 | 99.99th=[10537] 00:18:15.247 bw ( KiB/s): min= 4096, max=157696, per=1.81%, avg=49814.17, stdev=56834.53, samples=6 00:18:15.247 iops : min= 4, max= 154, avg=48.50, stdev=55.47, samples=6 00:18:15.247 lat (msec) : 250=0.36%, 500=12.41%, 750=15.69%, 2000=7.66%, >=2000=63.87% 00:18:15.247 cpu : usr=0.01%, sys=1.35%, ctx=265, majf=0, minf=32769 00:18:15.247 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.8%, 32=11.7%, >=64=77.0% 00:18:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.247 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:18:15.247 issued rwts: total=274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.247 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.247 job5: (groupid=0, jobs=1): err= 0: pid=3049142: Wed Apr 24 19:25:00 2024 00:18:15.247 read: IOPS=281, BW=281MiB/s (295MB/s)(2818MiB/10011msec) 00:18:15.247 slat (usec): min=38, max=1642.0k, avg=3545.36, stdev=37325.77 00:18:15.247 clat (msec): min=10, max=2029, avg=370.57, stdev=400.03 00:18:15.247 lat (msec): min=13, max=2040, avg=374.11, stdev=403.14 00:18:15.247 clat percentiles (msec): 00:18:15.247 | 1.00th=[ 100], 5.00th=[ 142], 10.00th=[ 144], 20.00th=[ 144], 00:18:15.248 | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 161], 00:18:15.248 | 70.00th=[ 296], 80.00th=[ 617], 90.00th=[ 1003], 95.00th=[ 1368], 00:18:15.248 | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 2022], 99.95th=[ 2022], 00:18:15.248 | 99.99th=[ 2022] 00:18:15.248 bw ( KiB/s): min= 6144, max=905453, per=13.57%, avg=374428.64, stdev=337829.64, samples=14 00:18:15.248 iops : min= 6, max= 884, avg=365.57, stdev=329.85, samples=14 00:18:15.248 lat (msec) : 20=0.28%, 50=0.21%, 100=0.53%, 250=65.86%, 500=7.27% 00:18:15.248 lat (msec) : 750=10.43%, 1000=5.25%, 2000=10.01%, >=2000=0.14% 00:18:15.248 cpu : usr=0.06%, sys=2.68%, ctx=2818, majf=0, minf=32769 00:18:15.248 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.6%, 32=1.1%, >=64=97.8% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.248 issued rwts: total=2818,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049143: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=161, BW=161MiB/s (169MB/s)(1688MiB/10469msec) 00:18:15.248 slat (usec): min=47, max=2075.8k, avg=6123.87, stdev=71177.47 00:18:15.248 clat (msec): min=121, max=2767, avg=762.81, stdev=750.76 00:18:15.248 lat (msec): min=287, max=2768, avg=768.93, stdev=752.80 00:18:15.248 clat percentiles (msec): 00:18:15.248 | 1.00th=[ 288], 5.00th=[ 300], 10.00th=[ 321], 20.00th=[ 393], 00:18:15.248 | 30.00th=[ 401], 40.00th=[ 405], 50.00th=[ 460], 60.00th=[ 558], 00:18:15.248 | 70.00th=[ 567], 80.00th=[ 600], 90.00th=[ 2467], 95.00th=[ 2601], 00:18:15.248 | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2769], 99.95th=[ 2769], 00:18:15.248 | 99.99th=[ 2769] 00:18:15.248 bw ( KiB/s): min=28672, max=446464, per=8.91%, avg=245725.69, stdev=99917.14, samples=13 00:18:15.248 iops : min= 28, max= 436, avg=239.92, stdev=97.59, samples=13 00:18:15.248 lat (msec) : 250=0.06%, 500=55.69%, 750=29.21%, >=2000=15.05% 00:18:15.248 cpu : usr=0.11%, sys=2.50%, ctx=1461, majf=0, minf=32769 00:18:15.248 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.5%, 16=0.9%, 32=1.9%, >=64=96.3% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.248 issued rwts: total=1688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049144: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=11, BW=11.9MiB/s (12.5MB/s)(125MiB/10487msec) 00:18:15.248 slat (usec): min=530, max=2035.0k, avg=83221.94, stdev=359355.66 00:18:15.248 clat (msec): min=83, max=10474, avg=4561.94, stdev=3539.41 00:18:15.248 lat (msec): min=1457, max=10486, avg=4645.16, stdev=3555.53 00:18:15.248 clat percentiles (msec): 00:18:15.248 | 1.00th=[ 1452], 5.00th=[ 1502], 10.00th=[ 1569], 20.00th=[ 1670], 00:18:15.248 | 30.00th=[ 1804], 40.00th=[ 1955], 50.00th=[ 2140], 60.00th=[ 4329], 00:18:15.248 | 70.00th=[ 6409], 80.00th=[ 8658], 90.00th=[10402], 95.00th=[10402], 00:18:15.248 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:18:15.248 | 99.99th=[10537] 00:18:15.248 lat (msec) : 100=0.80%, 2000=42.40%, >=2000=56.80% 00:18:15.248 cpu : usr=0.00%, sys=0.93%, ctx=205, majf=0, minf=32001 00:18:15.248 IO depths : 1=0.8%, 2=1.6%, 4=3.2%, 8=6.4%, 16=12.8%, 32=25.6%, >=64=49.6% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:15.248 issued rwts: total=125,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049146: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=56, BW=56.8MiB/s (59.5MB/s)(601MiB/10584msec) 00:18:15.248 slat (usec): min=61, max=2083.1k, avg=17369.36, stdev=158102.37 00:18:15.248 clat (msec): min=139, max=6859, avg=1930.34, stdev=2337.99 00:18:15.248 lat (msec): min=411, max=6859, avg=1947.71, stdev=2343.35 00:18:15.248 clat percentiles (msec): 00:18:15.248 | 1.00th=[ 409], 5.00th=[ 414], 10.00th=[ 422], 20.00th=[ 439], 00:18:15.248 | 30.00th=[ 493], 40.00th=[ 542], 50.00th=[ 567], 60.00th=[ 592], 00:18:15.248 | 70.00th=[ 2333], 80.00th=[ 4396], 90.00th=[ 6678], 95.00th=[ 6745], 00:18:15.248 | 99.00th=[ 6812], 99.50th=[ 6879], 99.90th=[ 6879], 99.95th=[ 6879], 00:18:15.248 | 99.99th=[ 6879] 00:18:15.248 bw ( KiB/s): min= 1943, max=311296, per=4.40%, avg=121330.88, stdev=128820.61, samples=8 00:18:15.248 iops : min= 1, max= 304, avg=118.38, stdev=125.92, samples=8 00:18:15.248 lat (msec) : 250=0.17%, 500=30.78%, 750=36.27%, >=2000=32.78% 00:18:15.248 cpu : usr=0.00%, sys=1.76%, ctx=509, majf=0, minf=32769 00:18:15.248 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.7%, 32=5.3%, >=64=89.5% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:15.248 issued rwts: total=601,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049147: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=54, BW=54.2MiB/s (56.8MB/s)(545MiB/10062msec) 00:18:15.248 slat (usec): min=444, max=2100.1k, avg=18371.76, stdev=145151.67 00:18:15.248 clat (msec): min=45, max=4939, avg=1781.27, stdev=1393.89 00:18:15.248 lat (msec): min=75, max=4952, avg=1799.65, stdev=1399.27 00:18:15.248 clat percentiles (msec): 00:18:15.248 | 1.00th=[ 122], 5.00th=[ 342], 10.00th=[ 592], 20.00th=[ 735], 00:18:15.248 | 30.00th=[ 877], 40.00th=[ 995], 50.00th=[ 1070], 60.00th=[ 1133], 00:18:15.248 | 70.00th=[ 2937], 80.00th=[ 3104], 90.00th=[ 3272], 95.00th=[ 4799], 00:18:15.248 | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], 00:18:15.248 | 99.99th=[ 4933] 00:18:15.248 bw ( KiB/s): min=28672, max=194560, per=3.87%, avg=106697.75, stdev=48377.11, samples=8 00:18:15.248 iops : min= 28, max= 190, avg=104.00, stdev=47.24, samples=8 00:18:15.248 lat (msec) : 50=0.18%, 100=0.55%, 250=3.12%, 500=4.40%, 750=13.03% 00:18:15.248 lat (msec) : 1000=18.72%, 2000=25.69%, >=2000=34.31% 00:18:15.248 cpu : usr=0.03%, sys=1.54%, ctx=1289, majf=0, minf=32285 00:18:15.248 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=2.9%, 32=5.9%, >=64=88.4% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:15.248 issued rwts: total=545,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049148: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=112, BW=112MiB/s (118MB/s)(1185MiB/10554msec) 00:18:15.248 slat (usec): min=51, max=2109.1k, avg=8783.10, stdev=104199.70 00:18:15.248 clat (msec): min=140, max=4655, avg=1090.95, stdev=1335.55 00:18:15.248 lat (msec): min=275, max=4661, avg=1099.73, stdev=1339.13 00:18:15.248 clat percentiles (msec): 00:18:15.248 | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 284], 00:18:15.248 | 30.00th=[ 313], 40.00th=[ 414], 50.00th=[ 443], 60.00th=[ 567], 00:18:15.248 | 70.00th=[ 617], 80.00th=[ 2534], 90.00th=[ 2702], 95.00th=[ 4530], 00:18:15.248 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:18:15.248 | 99.99th=[ 4665] 00:18:15.248 bw ( KiB/s): min= 2048, max=455567, per=7.85%, avg=216620.60, stdev=152989.63, samples=10 00:18:15.248 iops : min= 2, max= 444, avg=211.40, stdev=149.20, samples=10 00:18:15.248 lat (msec) : 250=0.08%, 500=55.53%, 750=21.60%, >=2000=22.78% 00:18:15.248 cpu : usr=0.08%, sys=2.12%, ctx=1042, majf=0, minf=32769 00:18:15.248 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.4%, 32=2.7%, >=64=94.7% 00:18:15.248 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.248 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.248 issued rwts: total=1185,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.248 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.248 job5: (groupid=0, jobs=1): err= 0: pid=3049149: Wed Apr 24 19:25:00 2024 00:18:15.248 read: IOPS=77, BW=77.9MiB/s (81.7MB/s)(817MiB/10485msec) 00:18:15.248 slat (usec): min=574, max=2118.9k, avg=12660.58, stdev=102558.82 00:18:15.248 clat (msec): min=136, max=4927, avg=1521.76, stdev=1340.76 00:18:15.248 lat (msec): min=554, max=4929, avg=1534.42, stdev=1342.58 00:18:15.249 clat percentiles (msec): 00:18:15.249 | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 567], 20.00th=[ 684], 00:18:15.249 | 30.00th=[ 835], 40.00th=[ 1070], 50.00th=[ 1116], 60.00th=[ 1150], 00:18:15.249 | 70.00th=[ 1183], 80.00th=[ 1217], 90.00th=[ 4597], 95.00th=[ 4732], 00:18:15.249 | 99.00th=[ 4866], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], 00:18:15.249 | 99.99th=[ 4933] 00:18:15.249 bw ( KiB/s): min=14336, max=237568, per=4.26%, avg=117563.08, stdev=67786.56, samples=12 00:18:15.249 iops : min= 14, max= 232, avg=114.75, stdev=66.16, samples=12 00:18:15.249 lat (msec) : 250=0.12%, 750=23.50%, 1000=12.48%, 2000=47.49%, >=2000=16.40% 00:18:15.249 cpu : usr=0.07%, sys=1.58%, ctx=1590, majf=0, minf=32769 00:18:15.249 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=3.9%, >=64=92.3% 00:18:15.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.249 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.249 issued rwts: total=817,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.249 job5: (groupid=0, jobs=1): err= 0: pid=3049150: Wed Apr 24 19:25:00 2024 00:18:15.249 read: IOPS=78, BW=78.4MiB/s (82.3MB/s)(829MiB/10568msec) 00:18:15.249 slat (usec): min=132, max=2113.2k, avg=12577.06, stdev=101702.73 00:18:15.249 clat (msec): min=136, max=4947, avg=1527.98, stdev=1336.99 00:18:15.249 lat (msec): min=559, max=4958, avg=1540.56, stdev=1338.81 00:18:15.249 clat percentiles (msec): 00:18:15.249 | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 575], 20.00th=[ 709], 00:18:15.249 | 30.00th=[ 860], 40.00th=[ 1099], 50.00th=[ 1116], 60.00th=[ 1150], 00:18:15.249 | 70.00th=[ 1167], 80.00th=[ 1200], 90.00th=[ 4597], 95.00th=[ 4799], 00:18:15.249 | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], 00:18:15.249 | 99.99th=[ 4933] 00:18:15.249 bw ( KiB/s): min= 2007, max=223232, per=4.01%, avg=110565.23, stdev=64335.26, samples=13 00:18:15.249 iops : min= 1, max= 218, avg=107.85, stdev=62.92, samples=13 00:18:15.249 lat (msec) : 250=0.12%, 750=21.59%, 1000=11.46%, 2000=50.78%, >=2000=16.04% 00:18:15.249 cpu : usr=0.06%, sys=1.71%, ctx=1606, majf=0, minf=32769 00:18:15.249 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.4% 00:18:15.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.249 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.249 issued rwts: total=829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.249 job5: (groupid=0, jobs=1): err= 0: pid=3049151: Wed Apr 24 19:25:00 2024 00:18:15.249 read: IOPS=82, BW=82.7MiB/s (86.7MB/s)(829MiB/10024msec) 00:18:15.249 slat (usec): min=65, max=2097.5k, avg=12057.44, stdev=117200.55 00:18:15.249 clat (msec): min=23, max=4678, avg=929.51, stdev=908.60 00:18:15.249 lat (msec): min=27, max=4695, avg=941.57, stdev=920.04 00:18:15.249 clat percentiles (msec): 00:18:15.249 | 1.00th=[ 32], 5.00th=[ 127], 10.00th=[ 309], 20.00th=[ 481], 00:18:15.249 | 30.00th=[ 514], 40.00th=[ 567], 50.00th=[ 600], 60.00th=[ 617], 00:18:15.249 | 70.00th=[ 676], 80.00th=[ 743], 90.00th=[ 2769], 95.00th=[ 2836], 00:18:15.249 | 99.00th=[ 2937], 99.50th=[ 4597], 99.90th=[ 4665], 99.95th=[ 4665], 00:18:15.249 | 99.99th=[ 4665] 00:18:15.249 bw ( KiB/s): min=30720, max=276480, per=6.03%, avg=166374.86, stdev=87955.46, samples=7 00:18:15.249 iops : min= 30, max= 270, avg=162.29, stdev=85.90, samples=7 00:18:15.249 lat (msec) : 50=1.93%, 100=1.81%, 250=4.95%, 500=16.65%, 750=56.33% 00:18:15.249 lat (msec) : 1000=1.21%, >=2000=17.13% 00:18:15.249 cpu : usr=0.02%, sys=1.52%, ctx=1282, majf=0, minf=32769 00:18:15.249 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.4% 00:18:15.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.249 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.249 issued rwts: total=829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.249 job5: (groupid=0, jobs=1): err= 0: pid=3049152: Wed Apr 24 19:25:00 2024 00:18:15.249 read: IOPS=87, BW=87.2MiB/s (91.4MB/s)(877MiB/10061msec) 00:18:15.249 slat (usec): min=63, max=2088.9k, avg=11398.65, stdev=120244.15 00:18:15.249 clat (msec): min=60, max=6987, avg=1410.56, stdev=2067.99 00:18:15.249 lat (msec): min=66, max=6995, avg=1421.96, stdev=2076.07 00:18:15.249 clat percentiles (msec): 00:18:15.249 | 1.00th=[ 107], 5.00th=[ 241], 10.00th=[ 422], 20.00th=[ 443], 00:18:15.249 | 30.00th=[ 451], 40.00th=[ 485], 50.00th=[ 518], 60.00th=[ 535], 00:18:15.249 | 70.00th=[ 575], 80.00th=[ 701], 90.00th=[ 4866], 95.00th=[ 6879], 00:18:15.249 | 99.00th=[ 6946], 99.50th=[ 6946], 99.90th=[ 7013], 99.95th=[ 7013], 00:18:15.249 | 99.99th=[ 7013] 00:18:15.249 bw ( KiB/s): min= 4096, max=290816, per=5.57%, avg=153600.00, stdev=109252.26, samples=10 00:18:15.249 iops : min= 4, max= 284, avg=150.00, stdev=106.69, samples=10 00:18:15.249 lat (msec) : 100=0.57%, 250=4.68%, 500=37.06%, 750=38.65%, >=2000=19.04% 00:18:15.249 cpu : usr=0.03%, sys=1.75%, ctx=813, majf=0, minf=32769 00:18:15.249 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=92.8% 00:18:15.249 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:15.249 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:15.249 issued rwts: total=877,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:15.249 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:15.249 00:18:15.249 Run status group 0 (all jobs): 00:18:15.249 READ: bw=2695MiB/s (2825MB/s), 736KiB/s-281MiB/s (754kB/s-295MB/s), io=33.3GiB (35.8GB), run=10011-12673msec 00:18:15.249 00:18:15.249 Disk stats (read/write): 00:18:15.249 nvme0n1: ios=23626/0, merge=0/0, ticks=8511516/0, in_queue=8511516, util=98.53% 00:18:15.249 nvme1n1: ios=47351/0, merge=0/0, ticks=10017358/0, in_queue=10017358, util=98.80% 00:18:15.249 nvme2n1: ios=29079/0, merge=0/0, ticks=10853898/0, in_queue=10853898, util=98.89% 00:18:15.249 nvme3n1: ios=36856/0, merge=0/0, ticks=9122885/0, in_queue=9122885, util=98.98% 00:18:15.249 nvme4n1: ios=43665/0, merge=0/0, ticks=10641894/0, in_queue=10641894, util=98.92% 00:18:15.249 nvme5n1: ios=90672/0, merge=0/0, ticks=11208003/0, in_queue=11208003, util=99.21% 00:18:15.249 19:25:00 -- target/srq_overwhelm.sh@38 -- # sync 00:18:15.249 19:25:00 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:18:15.249 19:25:00 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:15.249 19:25:00 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:18:15.249 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:18:15.249 19:25:01 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:18:15.249 19:25:01 -- common/autotest_common.sh@1205 -- # local i=0 00:18:15.249 19:25:01 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:15.249 19:25:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:18:15.249 19:25:01 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:15.249 19:25:01 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:18:15.249 19:25:01 -- common/autotest_common.sh@1217 -- # return 0 00:18:15.249 19:25:01 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:15.249 19:25:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.249 19:25:01 -- common/autotest_common.sh@10 -- # set +x 00:18:15.249 19:25:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.249 19:25:01 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:15.249 19:25:01 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:15.817 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:18:15.817 19:25:02 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:18:15.817 19:25:02 -- common/autotest_common.sh@1205 -- # local i=0 00:18:15.817 19:25:02 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:15.817 19:25:02 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:18:15.817 19:25:02 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:15.817 19:25:02 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:18:15.817 19:25:02 -- common/autotest_common.sh@1217 -- # return 0 00:18:15.817 19:25:02 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:15.817 19:25:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.817 19:25:02 -- common/autotest_common.sh@10 -- # set +x 00:18:15.817 19:25:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.817 19:25:02 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:15.817 19:25:02 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:18:16.753 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:18:16.753 19:25:03 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:18:16.753 19:25:03 -- common/autotest_common.sh@1205 -- # local i=0 00:18:16.753 19:25:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:16.753 19:25:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:18:16.753 19:25:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:16.753 19:25:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:18:16.753 19:25:03 -- common/autotest_common.sh@1217 -- # return 0 00:18:16.753 19:25:03 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:18:16.753 19:25:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:16.753 19:25:03 -- common/autotest_common.sh@10 -- # set +x 00:18:16.753 19:25:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:16.753 19:25:03 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:16.753 19:25:03 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:18:17.689 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:18:17.689 19:25:04 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:18:17.689 19:25:04 -- common/autotest_common.sh@1205 -- # local i=0 00:18:17.689 19:25:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:17.689 19:25:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:18:17.689 19:25:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:17.689 19:25:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:18:17.948 19:25:04 -- common/autotest_common.sh@1217 -- # return 0 00:18:17.948 19:25:04 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:18:17.948 19:25:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:17.948 19:25:04 -- common/autotest_common.sh@10 -- # set +x 00:18:17.948 19:25:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:17.948 19:25:04 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:17.948 19:25:04 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:18:18.886 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:18:18.886 19:25:05 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:18:18.886 19:25:05 -- common/autotest_common.sh@1205 -- # local i=0 00:18:18.886 19:25:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:18.886 19:25:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:18:18.886 19:25:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:18.886 19:25:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:18:18.886 19:25:05 -- common/autotest_common.sh@1217 -- # return 0 00:18:18.886 19:25:05 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:18:18.886 19:25:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:18.886 19:25:05 -- common/autotest_common.sh@10 -- # set +x 00:18:18.886 19:25:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:18.886 19:25:05 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:18.886 19:25:05 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:18:19.821 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:18:19.821 19:25:06 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:18:19.821 19:25:06 -- common/autotest_common.sh@1205 -- # local i=0 00:18:19.821 19:25:06 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:18:19.821 19:25:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:18:19.821 19:25:06 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:18:19.821 19:25:06 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:18:19.821 19:25:06 -- common/autotest_common.sh@1217 -- # return 0 00:18:19.821 19:25:06 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:18:19.821 19:25:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.821 19:25:06 -- common/autotest_common.sh@10 -- # set +x 00:18:19.821 19:25:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.821 19:25:06 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:18:19.821 19:25:06 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:18:19.821 19:25:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:19.821 19:25:06 -- nvmf/common.sh@117 -- # sync 00:18:19.821 19:25:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:19.821 19:25:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:19.821 19:25:06 -- nvmf/common.sh@120 -- # set +e 00:18:19.821 19:25:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:19.821 19:25:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:19.821 rmmod nvme_rdma 00:18:19.821 rmmod nvme_fabrics 00:18:19.821 19:25:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:19.822 19:25:06 -- nvmf/common.sh@124 -- # set -e 00:18:19.822 19:25:06 -- nvmf/common.sh@125 -- # return 0 00:18:19.822 19:25:06 -- nvmf/common.sh@478 -- # '[' -n 3047847 ']' 00:18:19.822 19:25:06 -- nvmf/common.sh@479 -- # killprocess 3047847 00:18:19.822 19:25:06 -- common/autotest_common.sh@936 -- # '[' -z 3047847 ']' 00:18:19.822 19:25:06 -- common/autotest_common.sh@940 -- # kill -0 3047847 00:18:19.822 19:25:06 -- common/autotest_common.sh@941 -- # uname 00:18:19.822 19:25:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.822 19:25:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3047847 00:18:20.085 19:25:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:20.085 19:25:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:20.085 19:25:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3047847' 00:18:20.085 killing process with pid 3047847 00:18:20.085 19:25:06 -- common/autotest_common.sh@955 -- # kill 3047847 00:18:20.085 19:25:06 -- common/autotest_common.sh@960 -- # wait 3047847 00:18:20.086 [2024-04-24 19:25:06.894909] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:20.346 19:25:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:20.346 19:25:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:20.346 00:18:20.346 real 0m34.027s 00:18:20.346 user 1m53.099s 00:18:20.346 sys 0m15.832s 00:18:20.346 19:25:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:20.346 19:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:20.346 ************************************ 00:18:20.346 END TEST nvmf_srq_overwhelm 00:18:20.346 ************************************ 00:18:20.346 19:25:07 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:18:20.346 19:25:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:20.346 19:25:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:20.346 19:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:20.606 ************************************ 00:18:20.606 START TEST nvmf_shutdown 00:18:20.606 ************************************ 00:18:20.606 19:25:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:18:20.606 * Looking for test storage... 00:18:20.606 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:20.606 19:25:07 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:20.606 19:25:07 -- nvmf/common.sh@7 -- # uname -s 00:18:20.606 19:25:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:20.606 19:25:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:20.606 19:25:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:20.606 19:25:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:20.606 19:25:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:20.606 19:25:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:20.606 19:25:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:20.606 19:25:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:20.606 19:25:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:20.606 19:25:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:20.606 19:25:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:18:20.606 19:25:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:18:20.606 19:25:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:20.606 19:25:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:20.606 19:25:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:20.606 19:25:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:20.606 19:25:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:20.606 19:25:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:20.606 19:25:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:20.606 19:25:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:20.606 19:25:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.606 19:25:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.606 19:25:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.606 19:25:07 -- paths/export.sh@5 -- # export PATH 00:18:20.606 19:25:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.606 19:25:07 -- nvmf/common.sh@47 -- # : 0 00:18:20.606 19:25:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:20.606 19:25:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:20.606 19:25:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:20.606 19:25:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:20.606 19:25:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:20.606 19:25:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:20.606 19:25:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:20.606 19:25:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:20.606 19:25:07 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:20.606 19:25:07 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:20.606 19:25:07 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:18:20.606 19:25:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:18:20.606 19:25:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:20.606 19:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:20.865 ************************************ 00:18:20.865 START TEST nvmf_shutdown_tc1 00:18:20.865 ************************************ 00:18:20.865 19:25:07 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:18:20.865 19:25:07 -- target/shutdown.sh@74 -- # starttarget 00:18:20.865 19:25:07 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:20.865 19:25:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:20.865 19:25:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:20.865 19:25:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:20.865 19:25:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:20.865 19:25:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:20.865 19:25:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.865 19:25:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.865 19:25:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:20.865 19:25:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:20.865 19:25:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:20.865 19:25:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:20.865 19:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:26.141 19:25:13 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:26.141 19:25:13 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:26.141 19:25:13 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:26.141 19:25:13 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:26.141 19:25:13 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:26.141 19:25:13 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:26.141 19:25:13 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:26.141 19:25:13 -- nvmf/common.sh@295 -- # net_devs=() 00:18:26.141 19:25:13 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:26.141 19:25:13 -- nvmf/common.sh@296 -- # e810=() 00:18:26.141 19:25:13 -- nvmf/common.sh@296 -- # local -ga e810 00:18:26.141 19:25:13 -- nvmf/common.sh@297 -- # x722=() 00:18:26.141 19:25:13 -- nvmf/common.sh@297 -- # local -ga x722 00:18:26.141 19:25:13 -- nvmf/common.sh@298 -- # mlx=() 00:18:26.141 19:25:13 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:26.141 19:25:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:26.141 19:25:13 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:26.141 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:26.141 19:25:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:26.141 19:25:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:26.141 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:26.141 19:25:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:26.141 19:25:13 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.141 19:25:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.141 19:25:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:26.141 Found net devices under 0000:18:00.0: mlx_0_0 00:18:26.141 19:25:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.141 19:25:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.141 19:25:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:26.141 Found net devices under 0000:18:00.1: mlx_0_1 00:18:26.141 19:25:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.141 19:25:13 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:26.141 19:25:13 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:26.141 19:25:13 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:26.141 19:25:13 -- nvmf/common.sh@58 -- # uname 00:18:26.141 19:25:13 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:26.141 19:25:13 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:26.141 19:25:13 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:26.141 19:25:13 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:26.141 19:25:13 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:26.141 19:25:13 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:26.141 19:25:13 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:26.141 19:25:13 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:26.141 19:25:13 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:26.141 19:25:13 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:26.141 19:25:13 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:26.141 19:25:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:26.141 19:25:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:26.141 19:25:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:26.141 19:25:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:26.141 19:25:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:26.141 19:25:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:26.141 19:25:13 -- nvmf/common.sh@105 -- # continue 2 00:18:26.141 19:25:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.141 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:26.141 19:25:13 -- nvmf/common.sh@105 -- # continue 2 00:18:26.141 19:25:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:26.141 19:25:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:26.141 19:25:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:26.141 19:25:13 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:26.141 19:25:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:26.141 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:26.141 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:18:26.141 altname enp24s0f0np0 00:18:26.141 altname ens785f0np0 00:18:26.141 inet 192.168.100.8/24 scope global mlx_0_0 00:18:26.141 valid_lft forever preferred_lft forever 00:18:26.141 19:25:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:26.141 19:25:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:26.141 19:25:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:26.141 19:25:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:26.141 19:25:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:26.141 19:25:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:26.141 19:25:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:26.142 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:26.142 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:18:26.142 altname enp24s0f1np1 00:18:26.142 altname ens785f1np1 00:18:26.142 inet 192.168.100.9/24 scope global mlx_0_1 00:18:26.142 valid_lft forever preferred_lft forever 00:18:26.142 19:25:13 -- nvmf/common.sh@411 -- # return 0 00:18:26.142 19:25:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:26.142 19:25:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:26.142 19:25:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:26.142 19:25:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:26.142 19:25:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:26.142 19:25:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:26.142 19:25:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:26.142 19:25:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:26.142 19:25:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:26.401 19:25:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:26.401 19:25:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:26.401 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.401 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:26.401 19:25:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:26.401 19:25:13 -- nvmf/common.sh@105 -- # continue 2 00:18:26.401 19:25:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:26.401 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.401 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:26.401 19:25:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:26.401 19:25:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:26.401 19:25:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:26.401 19:25:13 -- nvmf/common.sh@105 -- # continue 2 00:18:26.401 19:25:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:26.401 19:25:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:26.401 19:25:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:26.401 19:25:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:26.401 19:25:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:26.401 19:25:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:26.401 19:25:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:26.401 19:25:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:26.401 192.168.100.9' 00:18:26.401 19:25:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:26.401 192.168.100.9' 00:18:26.401 19:25:13 -- nvmf/common.sh@446 -- # head -n 1 00:18:26.401 19:25:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:26.401 19:25:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:26.401 192.168.100.9' 00:18:26.401 19:25:13 -- nvmf/common.sh@447 -- # head -n 1 00:18:26.401 19:25:13 -- nvmf/common.sh@447 -- # tail -n +2 00:18:26.401 19:25:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:26.401 19:25:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:26.401 19:25:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:26.401 19:25:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:26.401 19:25:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:26.401 19:25:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:26.401 19:25:13 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:26.401 19:25:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:26.401 19:25:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:26.401 19:25:13 -- common/autotest_common.sh@10 -- # set +x 00:18:26.401 19:25:13 -- nvmf/common.sh@470 -- # nvmfpid=3054414 00:18:26.401 19:25:13 -- nvmf/common.sh@471 -- # waitforlisten 3054414 00:18:26.401 19:25:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:26.401 19:25:13 -- common/autotest_common.sh@817 -- # '[' -z 3054414 ']' 00:18:26.401 19:25:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:26.401 19:25:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:26.401 19:25:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:26.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:26.401 19:25:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:26.401 19:25:13 -- common/autotest_common.sh@10 -- # set +x 00:18:26.401 [2024-04-24 19:25:13.298804] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:26.401 [2024-04-24 19:25:13.298873] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:26.401 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.401 [2024-04-24 19:25:13.371860] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:26.659 [2024-04-24 19:25:13.458546] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:26.660 [2024-04-24 19:25:13.458627] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:26.660 [2024-04-24 19:25:13.458637] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:26.660 [2024-04-24 19:25:13.458646] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:26.660 [2024-04-24 19:25:13.458653] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:26.660 [2024-04-24 19:25:13.458703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:26.660 [2024-04-24 19:25:13.458784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:26.660 [2024-04-24 19:25:13.458886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:26.660 [2024-04-24 19:25:13.458887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:27.226 19:25:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:27.226 19:25:14 -- common/autotest_common.sh@850 -- # return 0 00:18:27.226 19:25:14 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:27.226 19:25:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:27.226 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:27.226 19:25:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:27.226 19:25:14 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:27.226 19:25:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:27.226 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:27.226 [2024-04-24 19:25:14.205228] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x17c0530/0x17c4a20) succeed. 00:18:27.226 [2024-04-24 19:25:14.215897] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x17c1b70/0x18060b0) succeed. 00:18:27.486 19:25:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:27.486 19:25:14 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:27.486 19:25:14 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:27.486 19:25:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:27.486 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:27.486 19:25:14 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:27.486 19:25:14 -- target/shutdown.sh@28 -- # cat 00:18:27.486 19:25:14 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:27.486 19:25:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:27.486 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:27.486 Malloc1 00:18:27.486 [2024-04-24 19:25:14.465927] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:27.486 Malloc2 00:18:27.745 Malloc3 00:18:27.745 Malloc4 00:18:27.745 Malloc5 00:18:27.745 Malloc6 00:18:27.745 Malloc7 00:18:28.005 Malloc8 00:18:28.005 Malloc9 00:18:28.005 Malloc10 00:18:28.005 19:25:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.005 19:25:14 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:28.005 19:25:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:28.005 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:28.005 19:25:14 -- target/shutdown.sh@78 -- # perfpid=3054739 00:18:28.005 19:25:14 -- target/shutdown.sh@79 -- # waitforlisten 3054739 /var/tmp/bdevperf.sock 00:18:28.005 19:25:14 -- common/autotest_common.sh@817 -- # '[' -z 3054739 ']' 00:18:28.005 19:25:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:28.005 19:25:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:28.005 19:25:14 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:18:28.005 19:25:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:28.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:28.005 19:25:14 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:28.005 19:25:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:28.005 19:25:14 -- common/autotest_common.sh@10 -- # set +x 00:18:28.005 19:25:14 -- nvmf/common.sh@521 -- # config=() 00:18:28.005 19:25:14 -- nvmf/common.sh@521 -- # local subsystem config 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 [2024-04-24 19:25:14.980329] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:28.005 [2024-04-24 19:25:14.980395] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:14 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:15 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.005 19:25:15 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.005 { 00:18:28.005 "params": { 00:18:28.005 "name": "Nvme$subsystem", 00:18:28.005 "trtype": "$TEST_TRANSPORT", 00:18:28.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.005 "adrfam": "ipv4", 00:18:28.005 "trsvcid": "$NVMF_PORT", 00:18:28.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.005 "hdgst": ${hdgst:-false}, 00:18:28.005 "ddgst": ${ddgst:-false} 00:18:28.005 }, 00:18:28.005 "method": "bdev_nvme_attach_controller" 00:18:28.005 } 00:18:28.005 EOF 00:18:28.005 )") 00:18:28.005 19:25:15 -- nvmf/common.sh@543 -- # cat 00:18:28.005 19:25:15 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:28.006 19:25:15 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:28.006 { 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme$subsystem", 00:18:28.006 "trtype": "$TEST_TRANSPORT", 00:18:28.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "$NVMF_PORT", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.006 "hdgst": ${hdgst:-false}, 00:18:28.006 "ddgst": ${ddgst:-false} 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 } 00:18:28.006 EOF 00:18:28.006 )") 00:18:28.006 19:25:15 -- nvmf/common.sh@543 -- # cat 00:18:28.006 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.006 19:25:15 -- nvmf/common.sh@545 -- # jq . 00:18:28.006 19:25:15 -- nvmf/common.sh@546 -- # IFS=, 00:18:28.006 19:25:15 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme1", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme2", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme3", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme4", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme5", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme6", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme7", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme8", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme9", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 },{ 00:18:28.006 "params": { 00:18:28.006 "name": "Nvme10", 00:18:28.006 "trtype": "rdma", 00:18:28.006 "traddr": "192.168.100.8", 00:18:28.006 "adrfam": "ipv4", 00:18:28.006 "trsvcid": "4420", 00:18:28.006 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:28.006 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:28.006 "hdgst": false, 00:18:28.006 "ddgst": false 00:18:28.006 }, 00:18:28.006 "method": "bdev_nvme_attach_controller" 00:18:28.006 }' 00:18:28.265 [2024-04-24 19:25:15.057611] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:28.265 [2024-04-24 19:25:15.138776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:29.203 19:25:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:29.203 19:25:15 -- common/autotest_common.sh@850 -- # return 0 00:18:29.203 19:25:15 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:29.203 19:25:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:29.203 19:25:15 -- common/autotest_common.sh@10 -- # set +x 00:18:29.203 19:25:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:29.203 19:25:15 -- target/shutdown.sh@83 -- # kill -9 3054739 00:18:29.203 19:25:15 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:18:29.203 19:25:16 -- target/shutdown.sh@87 -- # sleep 1 00:18:30.141 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3054739 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:18:30.141 19:25:17 -- target/shutdown.sh@88 -- # kill -0 3054414 00:18:30.141 19:25:17 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:18:30.141 19:25:17 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:30.141 19:25:17 -- nvmf/common.sh@521 -- # config=() 00:18:30.141 19:25:17 -- nvmf/common.sh@521 -- # local subsystem config 00:18:30.141 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.141 { 00:18:30.141 "params": { 00:18:30.141 "name": "Nvme$subsystem", 00:18:30.141 "trtype": "$TEST_TRANSPORT", 00:18:30.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.141 "adrfam": "ipv4", 00:18:30.141 "trsvcid": "$NVMF_PORT", 00:18:30.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.141 "hdgst": ${hdgst:-false}, 00:18:30.141 "ddgst": ${ddgst:-false} 00:18:30.141 }, 00:18:30.141 "method": "bdev_nvme_attach_controller" 00:18:30.141 } 00:18:30.141 EOF 00:18:30.141 )") 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.141 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.141 { 00:18:30.141 "params": { 00:18:30.141 "name": "Nvme$subsystem", 00:18:30.141 "trtype": "$TEST_TRANSPORT", 00:18:30.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.141 "adrfam": "ipv4", 00:18:30.141 "trsvcid": "$NVMF_PORT", 00:18:30.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.141 "hdgst": ${hdgst:-false}, 00:18:30.141 "ddgst": ${ddgst:-false} 00:18:30.141 }, 00:18:30.141 "method": "bdev_nvme_attach_controller" 00:18:30.141 } 00:18:30.141 EOF 00:18:30.141 )") 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.141 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.141 { 00:18:30.141 "params": { 00:18:30.141 "name": "Nvme$subsystem", 00:18:30.141 "trtype": "$TEST_TRANSPORT", 00:18:30.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.141 "adrfam": "ipv4", 00:18:30.141 "trsvcid": "$NVMF_PORT", 00:18:30.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.141 "hdgst": ${hdgst:-false}, 00:18:30.141 "ddgst": ${ddgst:-false} 00:18:30.141 }, 00:18:30.141 "method": "bdev_nvme_attach_controller" 00:18:30.141 } 00:18:30.141 EOF 00:18:30.141 )") 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.141 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.141 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.141 { 00:18:30.141 "params": { 00:18:30.141 "name": "Nvme$subsystem", 00:18:30.141 "trtype": "$TEST_TRANSPORT", 00:18:30.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.141 "adrfam": "ipv4", 00:18:30.141 "trsvcid": "$NVMF_PORT", 00:18:30.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.141 "hdgst": ${hdgst:-false}, 00:18:30.141 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 [2024-04-24 19:25:17.057096] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:30.142 [2024-04-24 19:25:17.057154] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3055036 ] 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 19:25:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:30.142 { 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme$subsystem", 00:18:30.142 "trtype": "$TEST_TRANSPORT", 00:18:30.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "$NVMF_PORT", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:30.142 "hdgst": ${hdgst:-false}, 00:18:30.142 "ddgst": ${ddgst:-false} 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 } 00:18:30.142 EOF 00:18:30.142 )") 00:18:30.142 19:25:17 -- nvmf/common.sh@543 -- # cat 00:18:30.142 EAL: No free 2048 kB hugepages reported on node 1 00:18:30.142 19:25:17 -- nvmf/common.sh@545 -- # jq . 00:18:30.142 19:25:17 -- nvmf/common.sh@546 -- # IFS=, 00:18:30.142 19:25:17 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme1", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme2", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme3", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme4", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme5", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme6", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.142 },{ 00:18:30.142 "params": { 00:18:30.142 "name": "Nvme7", 00:18:30.142 "trtype": "rdma", 00:18:30.142 "traddr": "192.168.100.8", 00:18:30.142 "adrfam": "ipv4", 00:18:30.142 "trsvcid": "4420", 00:18:30.142 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:30.142 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:30.142 "hdgst": false, 00:18:30.142 "ddgst": false 00:18:30.142 }, 00:18:30.142 "method": "bdev_nvme_attach_controller" 00:18:30.143 },{ 00:18:30.143 "params": { 00:18:30.143 "name": "Nvme8", 00:18:30.143 "trtype": "rdma", 00:18:30.143 "traddr": "192.168.100.8", 00:18:30.143 "adrfam": "ipv4", 00:18:30.143 "trsvcid": "4420", 00:18:30.143 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:30.143 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:30.143 "hdgst": false, 00:18:30.143 "ddgst": false 00:18:30.143 }, 00:18:30.143 "method": "bdev_nvme_attach_controller" 00:18:30.143 },{ 00:18:30.143 "params": { 00:18:30.143 "name": "Nvme9", 00:18:30.143 "trtype": "rdma", 00:18:30.143 "traddr": "192.168.100.8", 00:18:30.143 "adrfam": "ipv4", 00:18:30.143 "trsvcid": "4420", 00:18:30.143 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:30.143 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:30.143 "hdgst": false, 00:18:30.143 "ddgst": false 00:18:30.143 }, 00:18:30.143 "method": "bdev_nvme_attach_controller" 00:18:30.143 },{ 00:18:30.143 "params": { 00:18:30.143 "name": "Nvme10", 00:18:30.143 "trtype": "rdma", 00:18:30.143 "traddr": "192.168.100.8", 00:18:30.143 "adrfam": "ipv4", 00:18:30.143 "trsvcid": "4420", 00:18:30.143 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:30.143 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:30.143 "hdgst": false, 00:18:30.143 "ddgst": false 00:18:30.143 }, 00:18:30.143 "method": "bdev_nvme_attach_controller" 00:18:30.143 }' 00:18:30.143 [2024-04-24 19:25:17.133077] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:30.402 [2024-04-24 19:25:17.215224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:31.352 Running I/O for 1 seconds... 00:18:32.370 00:18:32.370 Latency(us) 00:18:32.370 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:32.370 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme1n1 : 1.17 370.25 23.14 0.00 0.00 169588.38 9289.02 229774.91 00:18:32.370 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme2n1 : 1.17 384.38 24.02 0.00 0.00 161279.45 4843.97 165948.55 00:18:32.370 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme3n1 : 1.17 385.67 24.10 0.00 0.00 158275.25 5385.35 158654.11 00:18:32.370 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme4n1 : 1.17 386.91 24.18 0.00 0.00 156014.58 5014.93 149536.06 00:18:32.370 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme5n1 : 1.17 382.18 23.89 0.00 0.00 156034.83 19147.91 139506.20 00:18:32.370 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme6n1 : 1.17 381.74 23.86 0.00 0.00 153834.18 19717.79 130388.15 00:18:32.370 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme7n1 : 1.17 381.41 23.84 0.00 0.00 150866.87 19717.79 125829.12 00:18:32.370 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme8n1 : 1.18 398.52 24.91 0.00 0.00 143822.72 3120.08 115799.26 00:18:32.370 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme9n1 : 1.18 393.14 24.57 0.00 0.00 143647.43 3077.34 104857.60 00:18:32.370 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:32.370 Verification LBA range: start 0x0 length 0x400 00:18:32.370 Nvme10n1 : 1.18 271.60 16.97 0.00 0.00 205135.69 11682.50 393899.85 00:18:32.370 =================================================================================================================== 00:18:32.370 Total : 3735.79 233.49 0.00 0.00 158347.16 3077.34 393899.85 00:18:32.630 19:25:19 -- target/shutdown.sh@94 -- # stoptarget 00:18:32.630 19:25:19 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:32.630 19:25:19 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:32.630 19:25:19 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:32.630 19:25:19 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:32.630 19:25:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:32.630 19:25:19 -- nvmf/common.sh@117 -- # sync 00:18:32.630 19:25:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:32.630 19:25:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:32.630 19:25:19 -- nvmf/common.sh@120 -- # set +e 00:18:32.630 19:25:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:32.630 19:25:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:32.630 rmmod nvme_rdma 00:18:32.890 rmmod nvme_fabrics 00:18:32.890 19:25:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:32.890 19:25:19 -- nvmf/common.sh@124 -- # set -e 00:18:32.890 19:25:19 -- nvmf/common.sh@125 -- # return 0 00:18:32.890 19:25:19 -- nvmf/common.sh@478 -- # '[' -n 3054414 ']' 00:18:32.890 19:25:19 -- nvmf/common.sh@479 -- # killprocess 3054414 00:18:32.890 19:25:19 -- common/autotest_common.sh@936 -- # '[' -z 3054414 ']' 00:18:32.890 19:25:19 -- common/autotest_common.sh@940 -- # kill -0 3054414 00:18:32.890 19:25:19 -- common/autotest_common.sh@941 -- # uname 00:18:32.890 19:25:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:32.890 19:25:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3054414 00:18:32.890 19:25:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:32.890 19:25:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:32.890 19:25:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3054414' 00:18:32.890 killing process with pid 3054414 00:18:32.890 19:25:19 -- common/autotest_common.sh@955 -- # kill 3054414 00:18:32.890 19:25:19 -- common/autotest_common.sh@960 -- # wait 3054414 00:18:32.890 [2024-04-24 19:25:19.825247] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:33.459 19:25:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:33.459 19:25:20 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:33.459 00:18:33.459 real 0m12.570s 00:18:33.459 user 0m31.510s 00:18:33.459 sys 0m5.385s 00:18:33.459 19:25:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:33.459 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:18:33.459 ************************************ 00:18:33.459 END TEST nvmf_shutdown_tc1 00:18:33.459 ************************************ 00:18:33.459 19:25:20 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:18:33.459 19:25:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:18:33.459 19:25:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:33.459 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:18:33.459 ************************************ 00:18:33.459 START TEST nvmf_shutdown_tc2 00:18:33.459 ************************************ 00:18:33.459 19:25:20 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:18:33.459 19:25:20 -- target/shutdown.sh@99 -- # starttarget 00:18:33.459 19:25:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:33.459 19:25:20 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:33.459 19:25:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:33.459 19:25:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:33.459 19:25:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:33.459 19:25:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:33.459 19:25:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:33.459 19:25:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:33.459 19:25:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:33.459 19:25:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:33.459 19:25:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:33.459 19:25:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:33.459 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:18:33.459 19:25:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:33.459 19:25:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:33.460 19:25:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:33.460 19:25:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:33.460 19:25:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:33.460 19:25:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:33.460 19:25:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:33.460 19:25:20 -- nvmf/common.sh@295 -- # net_devs=() 00:18:33.460 19:25:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:33.460 19:25:20 -- nvmf/common.sh@296 -- # e810=() 00:18:33.460 19:25:20 -- nvmf/common.sh@296 -- # local -ga e810 00:18:33.460 19:25:20 -- nvmf/common.sh@297 -- # x722=() 00:18:33.460 19:25:20 -- nvmf/common.sh@297 -- # local -ga x722 00:18:33.460 19:25:20 -- nvmf/common.sh@298 -- # mlx=() 00:18:33.460 19:25:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:33.460 19:25:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:33.460 19:25:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:33.460 19:25:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:33.460 19:25:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:33.460 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:33.460 19:25:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:33.460 19:25:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:33.460 19:25:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:33.460 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:33.460 19:25:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:33.460 19:25:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:33.460 19:25:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:33.460 19:25:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:33.460 19:25:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:33.460 19:25:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:33.460 19:25:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:33.460 Found net devices under 0000:18:00.0: mlx_0_0 00:18:33.460 19:25:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:33.460 19:25:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:33.460 19:25:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:33.460 19:25:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:33.460 19:25:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:33.460 Found net devices under 0000:18:00.1: mlx_0_1 00:18:33.460 19:25:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:33.460 19:25:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:33.460 19:25:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:33.460 19:25:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:33.460 19:25:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:33.460 19:25:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:33.460 19:25:20 -- nvmf/common.sh@58 -- # uname 00:18:33.460 19:25:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:33.460 19:25:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:33.460 19:25:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:33.721 19:25:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:33.721 19:25:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:33.721 19:25:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:33.721 19:25:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:33.721 19:25:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:33.721 19:25:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:33.721 19:25:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:33.721 19:25:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:33.721 19:25:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:33.721 19:25:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:33.721 19:25:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:33.721 19:25:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:33.721 19:25:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:33.721 19:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@105 -- # continue 2 00:18:33.721 19:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@105 -- # continue 2 00:18:33.721 19:25:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:33.721 19:25:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:33.721 19:25:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:33.721 19:25:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:33.721 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:33.721 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:18:33.721 altname enp24s0f0np0 00:18:33.721 altname ens785f0np0 00:18:33.721 inet 192.168.100.8/24 scope global mlx_0_0 00:18:33.721 valid_lft forever preferred_lft forever 00:18:33.721 19:25:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:33.721 19:25:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:33.721 19:25:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:33.721 19:25:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:33.721 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:33.721 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:18:33.721 altname enp24s0f1np1 00:18:33.721 altname ens785f1np1 00:18:33.721 inet 192.168.100.9/24 scope global mlx_0_1 00:18:33.721 valid_lft forever preferred_lft forever 00:18:33.721 19:25:20 -- nvmf/common.sh@411 -- # return 0 00:18:33.721 19:25:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:33.721 19:25:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:33.721 19:25:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:33.721 19:25:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:33.721 19:25:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:33.721 19:25:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:33.721 19:25:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:33.721 19:25:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:33.721 19:25:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:33.721 19:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@105 -- # continue 2 00:18:33.721 19:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:33.721 19:25:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:33.721 19:25:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@105 -- # continue 2 00:18:33.721 19:25:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:33.721 19:25:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:33.721 19:25:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:33.721 19:25:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:33.721 19:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:33.721 19:25:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:33.721 192.168.100.9' 00:18:33.721 19:25:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:33.721 192.168.100.9' 00:18:33.721 19:25:20 -- nvmf/common.sh@446 -- # head -n 1 00:18:33.721 19:25:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:33.721 19:25:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:33.721 192.168.100.9' 00:18:33.721 19:25:20 -- nvmf/common.sh@447 -- # tail -n +2 00:18:33.721 19:25:20 -- nvmf/common.sh@447 -- # head -n 1 00:18:33.721 19:25:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:33.721 19:25:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:33.721 19:25:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:33.721 19:25:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:33.721 19:25:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:33.721 19:25:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:33.721 19:25:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:33.721 19:25:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:33.721 19:25:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:33.721 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:18:33.721 19:25:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:33.721 19:25:20 -- nvmf/common.sh@470 -- # nvmfpid=3055683 00:18:33.721 19:25:20 -- nvmf/common.sh@471 -- # waitforlisten 3055683 00:18:33.721 19:25:20 -- common/autotest_common.sh@817 -- # '[' -z 3055683 ']' 00:18:33.721 19:25:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:33.721 19:25:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:33.721 19:25:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:33.721 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:33.721 19:25:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:33.721 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:18:33.721 [2024-04-24 19:25:20.725057] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:33.721 [2024-04-24 19:25:20.725106] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:33.981 EAL: No free 2048 kB hugepages reported on node 1 00:18:33.981 [2024-04-24 19:25:20.809064] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:33.981 [2024-04-24 19:25:20.900349] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:33.981 [2024-04-24 19:25:20.900399] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:33.981 [2024-04-24 19:25:20.900409] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:33.981 [2024-04-24 19:25:20.900418] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:33.981 [2024-04-24 19:25:20.900442] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:33.981 [2024-04-24 19:25:20.900546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:33.981 [2024-04-24 19:25:20.900626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:33.981 [2024-04-24 19:25:20.900725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.981 [2024-04-24 19:25:20.900727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:34.550 19:25:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:34.550 19:25:21 -- common/autotest_common.sh@850 -- # return 0 00:18:34.550 19:25:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:34.550 19:25:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:34.550 19:25:21 -- common/autotest_common.sh@10 -- # set +x 00:18:34.809 19:25:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:34.809 19:25:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:34.809 19:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:34.809 19:25:21 -- common/autotest_common.sh@10 -- # set +x 00:18:34.809 [2024-04-24 19:25:21.629096] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x137b530/0x137fa20) succeed. 00:18:34.809 [2024-04-24 19:25:21.639544] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x137cb70/0x13c10b0) succeed. 00:18:34.809 19:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:34.809 19:25:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:34.809 19:25:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:34.809 19:25:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:34.809 19:25:21 -- common/autotest_common.sh@10 -- # set +x 00:18:34.809 19:25:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:34.809 19:25:21 -- target/shutdown.sh@28 -- # cat 00:18:34.809 19:25:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:34.809 19:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:34.809 19:25:21 -- common/autotest_common.sh@10 -- # set +x 00:18:35.069 Malloc1 00:18:35.069 [2024-04-24 19:25:21.872104] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:35.069 Malloc2 00:18:35.069 Malloc3 00:18:35.069 Malloc4 00:18:35.069 Malloc5 00:18:35.069 Malloc6 00:18:35.329 Malloc7 00:18:35.329 Malloc8 00:18:35.329 Malloc9 00:18:35.329 Malloc10 00:18:35.329 19:25:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:35.329 19:25:22 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:35.329 19:25:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:35.329 19:25:22 -- common/autotest_common.sh@10 -- # set +x 00:18:35.329 19:25:22 -- target/shutdown.sh@103 -- # perfpid=3055923 00:18:35.329 19:25:22 -- target/shutdown.sh@104 -- # waitforlisten 3055923 /var/tmp/bdevperf.sock 00:18:35.329 19:25:22 -- common/autotest_common.sh@817 -- # '[' -z 3055923 ']' 00:18:35.329 19:25:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:35.329 19:25:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:35.329 19:25:22 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:18:35.329 19:25:22 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:35.329 19:25:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:35.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:35.329 19:25:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:35.329 19:25:22 -- nvmf/common.sh@521 -- # config=() 00:18:35.329 19:25:22 -- common/autotest_common.sh@10 -- # set +x 00:18:35.329 19:25:22 -- nvmf/common.sh@521 -- # local subsystem config 00:18:35.329 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.329 { 00:18:35.329 "params": { 00:18:35.329 "name": "Nvme$subsystem", 00:18:35.329 "trtype": "$TEST_TRANSPORT", 00:18:35.329 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.329 "adrfam": "ipv4", 00:18:35.329 "trsvcid": "$NVMF_PORT", 00:18:35.329 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.329 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.329 "hdgst": ${hdgst:-false}, 00:18:35.329 "ddgst": ${ddgst:-false} 00:18:35.329 }, 00:18:35.329 "method": "bdev_nvme_attach_controller" 00:18:35.329 } 00:18:35.329 EOF 00:18:35.329 )") 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.329 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.329 { 00:18:35.329 "params": { 00:18:35.329 "name": "Nvme$subsystem", 00:18:35.329 "trtype": "$TEST_TRANSPORT", 00:18:35.329 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.329 "adrfam": "ipv4", 00:18:35.329 "trsvcid": "$NVMF_PORT", 00:18:35.329 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.329 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.329 "hdgst": ${hdgst:-false}, 00:18:35.329 "ddgst": ${ddgst:-false} 00:18:35.329 }, 00:18:35.329 "method": "bdev_nvme_attach_controller" 00:18:35.329 } 00:18:35.329 EOF 00:18:35.329 )") 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.329 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.329 { 00:18:35.329 "params": { 00:18:35.329 "name": "Nvme$subsystem", 00:18:35.329 "trtype": "$TEST_TRANSPORT", 00:18:35.329 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.329 "adrfam": "ipv4", 00:18:35.329 "trsvcid": "$NVMF_PORT", 00:18:35.329 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.329 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.329 "hdgst": ${hdgst:-false}, 00:18:35.329 "ddgst": ${ddgst:-false} 00:18:35.329 }, 00:18:35.329 "method": "bdev_nvme_attach_controller" 00:18:35.329 } 00:18:35.329 EOF 00:18:35.329 )") 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.329 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.329 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.329 { 00:18:35.329 "params": { 00:18:35.329 "name": "Nvme$subsystem", 00:18:35.329 "trtype": "$TEST_TRANSPORT", 00:18:35.329 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.329 "adrfam": "ipv4", 00:18:35.329 "trsvcid": "$NVMF_PORT", 00:18:35.329 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.329 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.329 "hdgst": ${hdgst:-false}, 00:18:35.329 "ddgst": ${ddgst:-false} 00:18:35.329 }, 00:18:35.329 "method": "bdev_nvme_attach_controller" 00:18:35.329 } 00:18:35.329 EOF 00:18:35.329 )") 00:18:35.589 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.589 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.589 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.589 { 00:18:35.589 "params": { 00:18:35.589 "name": "Nvme$subsystem", 00:18:35.589 "trtype": "$TEST_TRANSPORT", 00:18:35.589 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.589 "adrfam": "ipv4", 00:18:35.589 "trsvcid": "$NVMF_PORT", 00:18:35.589 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.589 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.589 "hdgst": ${hdgst:-false}, 00:18:35.589 "ddgst": ${ddgst:-false} 00:18:35.589 }, 00:18:35.589 "method": "bdev_nvme_attach_controller" 00:18:35.589 } 00:18:35.589 EOF 00:18:35.589 )") 00:18:35.589 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.589 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.589 [2024-04-24 19:25:22.364823] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:35.590 [2024-04-24 19:25:22.364882] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3055923 ] 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.590 { 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme$subsystem", 00:18:35.590 "trtype": "$TEST_TRANSPORT", 00:18:35.590 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "$NVMF_PORT", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.590 "hdgst": ${hdgst:-false}, 00:18:35.590 "ddgst": ${ddgst:-false} 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 } 00:18:35.590 EOF 00:18:35.590 )") 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.590 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.590 { 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme$subsystem", 00:18:35.590 "trtype": "$TEST_TRANSPORT", 00:18:35.590 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "$NVMF_PORT", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.590 "hdgst": ${hdgst:-false}, 00:18:35.590 "ddgst": ${ddgst:-false} 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 } 00:18:35.590 EOF 00:18:35.590 )") 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.590 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.590 { 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme$subsystem", 00:18:35.590 "trtype": "$TEST_TRANSPORT", 00:18:35.590 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "$NVMF_PORT", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.590 "hdgst": ${hdgst:-false}, 00:18:35.590 "ddgst": ${ddgst:-false} 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 } 00:18:35.590 EOF 00:18:35.590 )") 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.590 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.590 { 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme$subsystem", 00:18:35.590 "trtype": "$TEST_TRANSPORT", 00:18:35.590 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "$NVMF_PORT", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.590 "hdgst": ${hdgst:-false}, 00:18:35.590 "ddgst": ${ddgst:-false} 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 } 00:18:35.590 EOF 00:18:35.590 )") 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.590 19:25:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:35.590 { 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme$subsystem", 00:18:35.590 "trtype": "$TEST_TRANSPORT", 00:18:35.590 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "$NVMF_PORT", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:35.590 "hdgst": ${hdgst:-false}, 00:18:35.590 "ddgst": ${ddgst:-false} 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 } 00:18:35.590 EOF 00:18:35.590 )") 00:18:35.590 19:25:22 -- nvmf/common.sh@543 -- # cat 00:18:35.590 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.590 19:25:22 -- nvmf/common.sh@545 -- # jq . 00:18:35.590 19:25:22 -- nvmf/common.sh@546 -- # IFS=, 00:18:35.590 19:25:22 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme1", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme2", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme3", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme4", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme5", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme6", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme7", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme8", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme9", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 },{ 00:18:35.590 "params": { 00:18:35.590 "name": "Nvme10", 00:18:35.590 "trtype": "rdma", 00:18:35.590 "traddr": "192.168.100.8", 00:18:35.590 "adrfam": "ipv4", 00:18:35.590 "trsvcid": "4420", 00:18:35.590 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:35.590 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:35.590 "hdgst": false, 00:18:35.590 "ddgst": false 00:18:35.590 }, 00:18:35.590 "method": "bdev_nvme_attach_controller" 00:18:35.590 }' 00:18:35.590 [2024-04-24 19:25:22.439508] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:35.590 [2024-04-24 19:25:22.520804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:36.532 Running I/O for 10 seconds... 00:18:36.532 19:25:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:36.532 19:25:23 -- common/autotest_common.sh@850 -- # return 0 00:18:36.532 19:25:23 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:36.532 19:25:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.532 19:25:23 -- common/autotest_common.sh@10 -- # set +x 00:18:36.793 19:25:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.793 19:25:23 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:18:36.793 19:25:23 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:18:36.793 19:25:23 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:18:36.793 19:25:23 -- target/shutdown.sh@57 -- # local ret=1 00:18:36.793 19:25:23 -- target/shutdown.sh@58 -- # local i 00:18:36.793 19:25:23 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:18:36.793 19:25:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:36.793 19:25:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:36.793 19:25:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:36.793 19:25:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.793 19:25:23 -- common/autotest_common.sh@10 -- # set +x 00:18:36.793 19:25:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.793 19:25:23 -- target/shutdown.sh@60 -- # read_io_count=3 00:18:36.793 19:25:23 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:18:36.793 19:25:23 -- target/shutdown.sh@67 -- # sleep 0.25 00:18:37.053 19:25:23 -- target/shutdown.sh@59 -- # (( i-- )) 00:18:37.053 19:25:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:37.053 19:25:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:37.053 19:25:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:37.053 19:25:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:37.053 19:25:23 -- common/autotest_common.sh@10 -- # set +x 00:18:37.313 19:25:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:37.313 19:25:24 -- target/shutdown.sh@60 -- # read_io_count=147 00:18:37.313 19:25:24 -- target/shutdown.sh@63 -- # '[' 147 -ge 100 ']' 00:18:37.313 19:25:24 -- target/shutdown.sh@64 -- # ret=0 00:18:37.313 19:25:24 -- target/shutdown.sh@65 -- # break 00:18:37.313 19:25:24 -- target/shutdown.sh@69 -- # return 0 00:18:37.313 19:25:24 -- target/shutdown.sh@110 -- # killprocess 3055923 00:18:37.313 19:25:24 -- common/autotest_common.sh@936 -- # '[' -z 3055923 ']' 00:18:37.313 19:25:24 -- common/autotest_common.sh@940 -- # kill -0 3055923 00:18:37.313 19:25:24 -- common/autotest_common.sh@941 -- # uname 00:18:37.313 19:25:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:37.313 19:25:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3055923 00:18:37.313 19:25:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:37.313 19:25:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:37.313 19:25:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3055923' 00:18:37.313 killing process with pid 3055923 00:18:37.313 19:25:24 -- common/autotest_common.sh@955 -- # kill 3055923 00:18:37.313 19:25:24 -- common/autotest_common.sh@960 -- # wait 3055923 00:18:37.313 Received shutdown signal, test time was about 0.826419 seconds 00:18:37.313 00:18:37.313 Latency(us) 00:18:37.313 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.313 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme1n1 : 0.81 335.52 20.97 0.00 0.00 186809.45 7921.31 208803.39 00:18:37.313 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme2n1 : 0.81 354.63 22.16 0.00 0.00 173465.01 8206.25 198773.54 00:18:37.313 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme3n1 : 0.81 354.08 22.13 0.00 0.00 170264.59 8605.16 191479.10 00:18:37.313 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme4n1 : 0.81 392.85 24.55 0.00 0.00 150337.85 6696.07 133123.56 00:18:37.313 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme5n1 : 0.82 392.11 24.51 0.00 0.00 147953.57 9459.98 122181.90 00:18:37.313 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme6n1 : 0.82 391.41 24.46 0.00 0.00 145185.39 10200.82 111696.14 00:18:37.313 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme7n1 : 0.82 390.76 24.42 0.00 0.00 142110.10 10542.75 104857.60 00:18:37.313 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme8n1 : 0.82 390.16 24.38 0.00 0.00 139122.96 10941.66 100298.57 00:18:37.313 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme9n1 : 0.82 389.38 24.34 0.00 0.00 137168.09 11739.49 93004.13 00:18:37.313 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:37.313 Verification LBA range: start 0x0 length 0x400 00:18:37.313 Nvme10n1 : 0.83 310.01 19.38 0.00 0.00 167960.43 3034.60 213362.42 00:18:37.313 =================================================================================================================== 00:18:37.313 Total : 3700.90 231.31 0.00 0.00 154962.01 3034.60 213362.42 00:18:37.572 19:25:24 -- target/shutdown.sh@113 -- # sleep 1 00:18:38.947 19:25:25 -- target/shutdown.sh@114 -- # kill -0 3055683 00:18:38.947 19:25:25 -- target/shutdown.sh@116 -- # stoptarget 00:18:38.947 19:25:25 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:38.947 19:25:25 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:38.947 19:25:25 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:38.947 19:25:25 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:38.947 19:25:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:38.947 19:25:25 -- nvmf/common.sh@117 -- # sync 00:18:38.947 19:25:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:38.947 19:25:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:38.947 19:25:25 -- nvmf/common.sh@120 -- # set +e 00:18:38.947 19:25:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:38.947 19:25:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:38.947 rmmod nvme_rdma 00:18:38.947 rmmod nvme_fabrics 00:18:38.947 19:25:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:38.947 19:25:25 -- nvmf/common.sh@124 -- # set -e 00:18:38.947 19:25:25 -- nvmf/common.sh@125 -- # return 0 00:18:38.947 19:25:25 -- nvmf/common.sh@478 -- # '[' -n 3055683 ']' 00:18:38.947 19:25:25 -- nvmf/common.sh@479 -- # killprocess 3055683 00:18:38.947 19:25:25 -- common/autotest_common.sh@936 -- # '[' -z 3055683 ']' 00:18:38.947 19:25:25 -- common/autotest_common.sh@940 -- # kill -0 3055683 00:18:38.947 19:25:25 -- common/autotest_common.sh@941 -- # uname 00:18:38.947 19:25:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.947 19:25:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3055683 00:18:38.947 19:25:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:38.947 19:25:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:38.947 19:25:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3055683' 00:18:38.947 killing process with pid 3055683 00:18:38.947 19:25:25 -- common/autotest_common.sh@955 -- # kill 3055683 00:18:38.947 19:25:25 -- common/autotest_common.sh@960 -- # wait 3055683 00:18:38.947 [2024-04-24 19:25:25.762802] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:39.268 19:25:26 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:39.268 19:25:26 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:39.268 00:18:39.268 real 0m5.782s 00:18:39.268 user 0m23.105s 00:18:39.269 sys 0m1.216s 00:18:39.269 19:25:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:39.269 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:18:39.269 ************************************ 00:18:39.269 END TEST nvmf_shutdown_tc2 00:18:39.269 ************************************ 00:18:39.269 19:25:26 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:18:39.269 19:25:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:18:39.269 19:25:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:39.269 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:18:39.528 ************************************ 00:18:39.528 START TEST nvmf_shutdown_tc3 00:18:39.528 ************************************ 00:18:39.528 19:25:26 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:18:39.528 19:25:26 -- target/shutdown.sh@121 -- # starttarget 00:18:39.528 19:25:26 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:39.528 19:25:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:39.528 19:25:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:39.528 19:25:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:39.528 19:25:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:39.528 19:25:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.528 19:25:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.528 19:25:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.528 19:25:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:39.528 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:18:39.528 19:25:26 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:39.528 19:25:26 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:39.528 19:25:26 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:39.528 19:25:26 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:39.528 19:25:26 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:39.528 19:25:26 -- nvmf/common.sh@295 -- # net_devs=() 00:18:39.528 19:25:26 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@296 -- # e810=() 00:18:39.528 19:25:26 -- nvmf/common.sh@296 -- # local -ga e810 00:18:39.528 19:25:26 -- nvmf/common.sh@297 -- # x722=() 00:18:39.528 19:25:26 -- nvmf/common.sh@297 -- # local -ga x722 00:18:39.528 19:25:26 -- nvmf/common.sh@298 -- # mlx=() 00:18:39.528 19:25:26 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:39.528 19:25:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:39.528 19:25:26 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:39.528 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:39.528 19:25:26 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:39.528 19:25:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:39.528 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:39.528 19:25:26 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:39.528 19:25:26 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.528 19:25:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.528 19:25:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:39.528 Found net devices under 0000:18:00.0: mlx_0_0 00:18:39.528 19:25:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:39.528 19:25:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:39.528 19:25:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:39.528 Found net devices under 0000:18:00.1: mlx_0_1 00:18:39.528 19:25:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:39.528 19:25:26 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:39.528 19:25:26 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:39.528 19:25:26 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:39.528 19:25:26 -- nvmf/common.sh@58 -- # uname 00:18:39.528 19:25:26 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:39.528 19:25:26 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:39.528 19:25:26 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:39.528 19:25:26 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:39.528 19:25:26 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:39.528 19:25:26 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:39.528 19:25:26 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:39.528 19:25:26 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:39.528 19:25:26 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:39.528 19:25:26 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:39.528 19:25:26 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:39.528 19:25:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:39.528 19:25:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:39.528 19:25:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:39.528 19:25:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:39.528 19:25:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.528 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:39.528 19:25:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:39.528 19:25:26 -- nvmf/common.sh@105 -- # continue 2 00:18:39.529 19:25:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:39.529 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.529 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:39.529 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.529 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:39.529 19:25:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:39.529 19:25:26 -- nvmf/common.sh@105 -- # continue 2 00:18:39.529 19:25:26 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:39.529 19:25:26 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:39.529 19:25:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:39.529 19:25:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:39.529 19:25:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:39.529 19:25:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:39.529 19:25:26 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:39.529 19:25:26 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:39.529 19:25:26 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:39.787 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:39.788 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:18:39.788 altname enp24s0f0np0 00:18:39.788 altname ens785f0np0 00:18:39.788 inet 192.168.100.8/24 scope global mlx_0_0 00:18:39.788 valid_lft forever preferred_lft forever 00:18:39.788 19:25:26 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:39.788 19:25:26 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:39.788 19:25:26 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:39.788 19:25:26 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:39.788 19:25:26 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:39.788 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:39.788 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:18:39.788 altname enp24s0f1np1 00:18:39.788 altname ens785f1np1 00:18:39.788 inet 192.168.100.9/24 scope global mlx_0_1 00:18:39.788 valid_lft forever preferred_lft forever 00:18:39.788 19:25:26 -- nvmf/common.sh@411 -- # return 0 00:18:39.788 19:25:26 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:39.788 19:25:26 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:39.788 19:25:26 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:39.788 19:25:26 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:39.788 19:25:26 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:39.788 19:25:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:39.788 19:25:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:39.788 19:25:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:39.788 19:25:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:39.788 19:25:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:39.788 19:25:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:39.788 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.788 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:39.788 19:25:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:39.788 19:25:26 -- nvmf/common.sh@105 -- # continue 2 00:18:39.788 19:25:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:39.788 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.788 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:39.788 19:25:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:39.788 19:25:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:39.788 19:25:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@105 -- # continue 2 00:18:39.788 19:25:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:39.788 19:25:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:39.788 19:25:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:39.788 19:25:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:39.788 19:25:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:39.788 19:25:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:39.788 19:25:26 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:39.788 192.168.100.9' 00:18:39.788 19:25:26 -- nvmf/common.sh@446 -- # head -n 1 00:18:39.788 19:25:26 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:39.788 192.168.100.9' 00:18:39.788 19:25:26 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:39.788 19:25:26 -- nvmf/common.sh@447 -- # tail -n +2 00:18:39.788 19:25:26 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:39.788 192.168.100.9' 00:18:39.788 19:25:26 -- nvmf/common.sh@447 -- # head -n 1 00:18:39.788 19:25:26 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:39.788 19:25:26 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:39.788 19:25:26 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:39.788 19:25:26 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:39.788 19:25:26 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:39.788 19:25:26 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:39.788 19:25:26 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:39.788 19:25:26 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:39.788 19:25:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:39.788 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:18:39.788 19:25:26 -- nvmf/common.sh@470 -- # nvmfpid=3056590 00:18:39.788 19:25:26 -- nvmf/common.sh@471 -- # waitforlisten 3056590 00:18:39.788 19:25:26 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:39.788 19:25:26 -- common/autotest_common.sh@817 -- # '[' -z 3056590 ']' 00:18:39.788 19:25:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:39.788 19:25:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:39.788 19:25:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:39.788 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:39.788 19:25:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:39.788 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:18:39.788 [2024-04-24 19:25:26.725991] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:39.788 [2024-04-24 19:25:26.726049] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:39.788 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.788 [2024-04-24 19:25:26.796387] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:40.046 [2024-04-24 19:25:26.884022] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:40.046 [2024-04-24 19:25:26.884069] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:40.046 [2024-04-24 19:25:26.884078] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:40.046 [2024-04-24 19:25:26.884087] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:40.046 [2024-04-24 19:25:26.884094] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:40.046 [2024-04-24 19:25:26.884150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:40.046 [2024-04-24 19:25:26.884209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:40.046 [2024-04-24 19:25:26.884316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:40.046 [2024-04-24 19:25:26.884317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:40.614 19:25:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:40.614 19:25:27 -- common/autotest_common.sh@850 -- # return 0 00:18:40.614 19:25:27 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:40.614 19:25:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:40.614 19:25:27 -- common/autotest_common.sh@10 -- # set +x 00:18:40.614 19:25:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:40.614 19:25:27 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:40.614 19:25:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:40.614 19:25:27 -- common/autotest_common.sh@10 -- # set +x 00:18:40.614 [2024-04-24 19:25:27.621472] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x576530/0x57aa20) succeed. 00:18:40.614 [2024-04-24 19:25:27.632183] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x577b70/0x5bc0b0) succeed. 00:18:40.873 19:25:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:40.873 19:25:27 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:40.873 19:25:27 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:40.873 19:25:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:40.873 19:25:27 -- common/autotest_common.sh@10 -- # set +x 00:18:40.873 19:25:27 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:40.873 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.873 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.873 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.873 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:40.874 19:25:27 -- target/shutdown.sh@28 -- # cat 00:18:40.874 19:25:27 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:40.874 19:25:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:40.874 19:25:27 -- common/autotest_common.sh@10 -- # set +x 00:18:40.874 Malloc1 00:18:40.874 [2024-04-24 19:25:27.871829] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:41.133 Malloc2 00:18:41.133 Malloc3 00:18:41.133 Malloc4 00:18:41.133 Malloc5 00:18:41.133 Malloc6 00:18:41.133 Malloc7 00:18:41.393 Malloc8 00:18:41.393 Malloc9 00:18:41.393 Malloc10 00:18:41.393 19:25:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:41.393 19:25:28 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:41.393 19:25:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:41.393 19:25:28 -- common/autotest_common.sh@10 -- # set +x 00:18:41.393 19:25:28 -- target/shutdown.sh@125 -- # perfpid=3056829 00:18:41.393 19:25:28 -- target/shutdown.sh@126 -- # waitforlisten 3056829 /var/tmp/bdevperf.sock 00:18:41.393 19:25:28 -- common/autotest_common.sh@817 -- # '[' -z 3056829 ']' 00:18:41.393 19:25:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:41.393 19:25:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:41.393 19:25:28 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:18:41.393 19:25:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:41.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:41.393 19:25:28 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:41.393 19:25:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:41.393 19:25:28 -- nvmf/common.sh@521 -- # config=() 00:18:41.393 19:25:28 -- common/autotest_common.sh@10 -- # set +x 00:18:41.393 19:25:28 -- nvmf/common.sh@521 -- # local subsystem config 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 [2024-04-24 19:25:28.389673] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:41.393 [2024-04-24 19:25:28.389737] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3056829 ] 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.393 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.393 { 00:18:41.393 "params": { 00:18:41.393 "name": "Nvme$subsystem", 00:18:41.393 "trtype": "$TEST_TRANSPORT", 00:18:41.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.393 "adrfam": "ipv4", 00:18:41.393 "trsvcid": "$NVMF_PORT", 00:18:41.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.393 "hdgst": ${hdgst:-false}, 00:18:41.393 "ddgst": ${ddgst:-false} 00:18:41.393 }, 00:18:41.393 "method": "bdev_nvme_attach_controller" 00:18:41.393 } 00:18:41.393 EOF 00:18:41.393 )") 00:18:41.393 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.653 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.653 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.653 { 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme$subsystem", 00:18:41.653 "trtype": "$TEST_TRANSPORT", 00:18:41.653 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.653 "adrfam": "ipv4", 00:18:41.653 "trsvcid": "$NVMF_PORT", 00:18:41.653 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.653 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.653 "hdgst": ${hdgst:-false}, 00:18:41.653 "ddgst": ${ddgst:-false} 00:18:41.653 }, 00:18:41.653 "method": "bdev_nvme_attach_controller" 00:18:41.653 } 00:18:41.653 EOF 00:18:41.653 )") 00:18:41.653 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.653 19:25:28 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:41.653 19:25:28 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:41.653 { 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme$subsystem", 00:18:41.653 "trtype": "$TEST_TRANSPORT", 00:18:41.653 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:41.653 "adrfam": "ipv4", 00:18:41.653 "trsvcid": "$NVMF_PORT", 00:18:41.653 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:41.653 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:41.653 "hdgst": ${hdgst:-false}, 00:18:41.653 "ddgst": ${ddgst:-false} 00:18:41.653 }, 00:18:41.653 "method": "bdev_nvme_attach_controller" 00:18:41.653 } 00:18:41.653 EOF 00:18:41.653 )") 00:18:41.653 EAL: No free 2048 kB hugepages reported on node 1 00:18:41.653 19:25:28 -- nvmf/common.sh@543 -- # cat 00:18:41.653 19:25:28 -- nvmf/common.sh@545 -- # jq . 00:18:41.653 19:25:28 -- nvmf/common.sh@546 -- # IFS=, 00:18:41.653 19:25:28 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme1", 00:18:41.653 "trtype": "rdma", 00:18:41.653 "traddr": "192.168.100.8", 00:18:41.653 "adrfam": "ipv4", 00:18:41.653 "trsvcid": "4420", 00:18:41.653 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:41.653 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:41.653 "hdgst": false, 00:18:41.653 "ddgst": false 00:18:41.653 }, 00:18:41.653 "method": "bdev_nvme_attach_controller" 00:18:41.653 },{ 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme2", 00:18:41.653 "trtype": "rdma", 00:18:41.653 "traddr": "192.168.100.8", 00:18:41.653 "adrfam": "ipv4", 00:18:41.653 "trsvcid": "4420", 00:18:41.653 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:41.653 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:41.653 "hdgst": false, 00:18:41.653 "ddgst": false 00:18:41.653 }, 00:18:41.653 "method": "bdev_nvme_attach_controller" 00:18:41.653 },{ 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme3", 00:18:41.653 "trtype": "rdma", 00:18:41.653 "traddr": "192.168.100.8", 00:18:41.653 "adrfam": "ipv4", 00:18:41.653 "trsvcid": "4420", 00:18:41.653 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:41.653 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:41.653 "hdgst": false, 00:18:41.653 "ddgst": false 00:18:41.653 }, 00:18:41.653 "method": "bdev_nvme_attach_controller" 00:18:41.653 },{ 00:18:41.653 "params": { 00:18:41.653 "name": "Nvme4", 00:18:41.653 "trtype": "rdma", 00:18:41.653 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme5", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme6", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme7", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme8", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme9", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 },{ 00:18:41.654 "params": { 00:18:41.654 "name": "Nvme10", 00:18:41.654 "trtype": "rdma", 00:18:41.654 "traddr": "192.168.100.8", 00:18:41.654 "adrfam": "ipv4", 00:18:41.654 "trsvcid": "4420", 00:18:41.654 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:41.654 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:41.654 "hdgst": false, 00:18:41.654 "ddgst": false 00:18:41.654 }, 00:18:41.654 "method": "bdev_nvme_attach_controller" 00:18:41.654 }' 00:18:41.654 [2024-04-24 19:25:28.465846] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:41.654 [2024-04-24 19:25:28.547340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:42.591 Running I/O for 10 seconds... 00:18:42.591 19:25:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:42.591 19:25:29 -- common/autotest_common.sh@850 -- # return 0 00:18:42.591 19:25:29 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:42.591 19:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:42.591 19:25:29 -- common/autotest_common.sh@10 -- # set +x 00:18:42.591 19:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:42.591 19:25:29 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:42.591 19:25:29 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:18:42.591 19:25:29 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:18:42.591 19:25:29 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:18:42.591 19:25:29 -- target/shutdown.sh@57 -- # local ret=1 00:18:42.591 19:25:29 -- target/shutdown.sh@58 -- # local i 00:18:42.591 19:25:29 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:18:42.591 19:25:29 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:42.591 19:25:29 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:42.591 19:25:29 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:42.591 19:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:42.591 19:25:29 -- common/autotest_common.sh@10 -- # set +x 00:18:42.851 19:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:42.851 19:25:29 -- target/shutdown.sh@60 -- # read_io_count=3 00:18:42.851 19:25:29 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:18:42.851 19:25:29 -- target/shutdown.sh@67 -- # sleep 0.25 00:18:43.110 19:25:29 -- target/shutdown.sh@59 -- # (( i-- )) 00:18:43.110 19:25:29 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:43.110 19:25:29 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:43.110 19:25:29 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:43.110 19:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:43.110 19:25:29 -- common/autotest_common.sh@10 -- # set +x 00:18:43.110 19:25:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:43.371 19:25:30 -- target/shutdown.sh@60 -- # read_io_count=147 00:18:43.371 19:25:30 -- target/shutdown.sh@63 -- # '[' 147 -ge 100 ']' 00:18:43.371 19:25:30 -- target/shutdown.sh@64 -- # ret=0 00:18:43.371 19:25:30 -- target/shutdown.sh@65 -- # break 00:18:43.371 19:25:30 -- target/shutdown.sh@69 -- # return 0 00:18:43.371 19:25:30 -- target/shutdown.sh@135 -- # killprocess 3056590 00:18:43.371 19:25:30 -- common/autotest_common.sh@936 -- # '[' -z 3056590 ']' 00:18:43.371 19:25:30 -- common/autotest_common.sh@940 -- # kill -0 3056590 00:18:43.371 19:25:30 -- common/autotest_common.sh@941 -- # uname 00:18:43.371 19:25:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:43.371 19:25:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3056590 00:18:43.371 19:25:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:43.371 19:25:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:43.371 19:25:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3056590' 00:18:43.371 killing process with pid 3056590 00:18:43.371 19:25:30 -- common/autotest_common.sh@955 -- # kill 3056590 00:18:43.371 19:25:30 -- common/autotest_common.sh@960 -- # wait 3056590 00:18:43.371 [2024-04-24 19:25:30.308215] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:43.940 19:25:30 -- target/shutdown.sh@136 -- # nvmfpid= 00:18:43.940 19:25:30 -- target/shutdown.sh@139 -- # sleep 1 00:18:44.515 [2024-04-24 19:25:31.247449] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.249561] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.251757] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.254255] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.256204] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.258450] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.261067] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:18:44.515 [2024-04-24 19:25:31.261137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aabfc80 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaafc00 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa9fb80 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa8fb00 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa7fa80 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa6fa00 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa5f980 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa4f900 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa3f880 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa2f800 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa1f780 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa0f700 len:0x10000 key:0x184200 00:18:44.515 [2024-04-24 19:25:31.261508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a83f280 len:0x10000 key:0x183900 00:18:44.515 [2024-04-24 19:25:31.261538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a82f200 len:0x10000 key:0x183900 00:18:44.515 [2024-04-24 19:25:31.261572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a81f180 len:0x10000 key:0x183900 00:18:44.515 [2024-04-24 19:25:31.261602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a80f100 len:0x10000 key:0x183900 00:18:44.515 [2024-04-24 19:25:31.261634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adf0000 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001addff80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adcff00 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adbfe80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adafe00 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad9fd80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad8fd00 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad7fc80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad6fc00 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad5fb80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad4fb00 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.515 [2024-04-24 19:25:31.261983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad3fa80 len:0x10000 key:0x183500 00:18:44.515 [2024-04-24 19:25:31.261997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad2fa00 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad1f980 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad0f900 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acff880 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acef800 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acdf780 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001accf700 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acbf680 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acaf600 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac9f580 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac8f500 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac7f480 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac6f400 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac5f380 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac4f300 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac3f280 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac2f200 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac1f180 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac0f100 len:0x10000 key:0x183500 00:18:44.516 [2024-04-24 19:25:31.262581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aff0000 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afdff80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afcff00 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afbfe80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afafe00 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af9fd80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af8fd00 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af7fc80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af6fc00 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af5fb80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af4fb00 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.516 [2024-04-24 19:25:31.262945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af3fa80 len:0x10000 key:0x183000 00:18:44.516 [2024-04-24 19:25:31.262958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.262974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af2fa00 len:0x10000 key:0x183000 00:18:44.517 [2024-04-24 19:25:31.262988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.263007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af1f980 len:0x10000 key:0x183000 00:18:44.517 [2024-04-24 19:25:31.263023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.263039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaefe00 len:0x10000 key:0x184200 00:18:44.517 [2024-04-24 19:25:31.263053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.263069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000fc93000 len:0x10000 key:0x182a00 00:18:44.517 [2024-04-24 19:25:31.263082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.263099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000fc72000 len:0x10000 key:0x182a00 00:18:44.517 [2024-04-24 19:25:31.263112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32591 cdw0:7349c990 sqhd:608c p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265332] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:18:44.517 [2024-04-24 19:25:31.265361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1f0000 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1dff80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1cff00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1bfe80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1afe00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b19fd80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b18fd00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b17fc80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b16fc00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b15fb80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b14fb00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b13fa80 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b12fa00 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b11f980 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b10f900 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ff880 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.265980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.265994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.266010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.266024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.266040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.266054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.266070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.266084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.266100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.266114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.517 [2024-04-24 19:25:31.266130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0x183400 00:18:44.517 [2024-04-24 19:25:31.266144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0x183400 00:18:44.518 [2024-04-24 19:25:31.266173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0x183400 00:18:44.518 [2024-04-24 19:25:31.266203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0x183400 00:18:44.518 [2024-04-24 19:25:31.266234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0x183400 00:18:44.518 [2024-04-24 19:25:31.266267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0x183400 00:18:44.518 [2024-04-24 19:25:31.266296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.266971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.266987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x183800 00:18:44.518 [2024-04-24 19:25:31.267239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.518 [2024-04-24 19:25:31.267255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.267269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.267287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0x183000 00:18:44.519 [2024-04-24 19:25:31.267301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:5080 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269507] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:18:44.519 [2024-04-24 19:25:31.269535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x183b00 00:18:44.519 [2024-04-24 19:25:31.269922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.269951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.269981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.269997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x183e00 00:18:44.519 [2024-04-24 19:25:31.270251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.519 [2024-04-24 19:25:31.270267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x183e00 00:18:44.520 [2024-04-24 19:25:31.270872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.270903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.270932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.270962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.270978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.270992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.520 [2024-04-24 19:25:31.271342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x183d00 00:18:44.520 [2024-04-24 19:25:31.271355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.271371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x183d00 00:18:44.521 [2024-04-24 19:25:31.271385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.271401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x183d00 00:18:44.521 [2024-04-24 19:25:31.271415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.271431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x183d00 00:18:44.521 [2024-04-24 19:25:31.271444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.271460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x183b00 00:18:44.521 [2024-04-24 19:25:31.271474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:41af440 sqhd:e430 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.274196] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:18:44.521 [2024-04-24 19:25:31.274296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.274314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.274332] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.274346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.274363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.274378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.274393] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.274406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:44.521 [2024-04-24 19:25:31.276512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.276532] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:44.521 [2024-04-24 19:25:31.276547] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.276575] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.276590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.276605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.276619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.276633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.276647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.276662] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.276675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.278806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.278825] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:18:44.521 [2024-04-24 19:25:31.278837] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.278857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.278871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.278886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.278900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.278914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.278927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.278942] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.278955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.281027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.281044] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:18:44.521 [2024-04-24 19:25:31.281057] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.281077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.281091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.281106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.281120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.281134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.281148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.281164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.281177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.283284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.283324] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:18:44.521 [2024-04-24 19:25:31.283354] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.283398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.283430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.283463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.283493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.283526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.283578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.283612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.283642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.285902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.285942] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:18:44.521 [2024-04-24 19:25:31.285971] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.286013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.286053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.286086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.286117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.286149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.286180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.286212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.286243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.288494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.521 [2024-04-24 19:25:31.288536] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:18:44.521 [2024-04-24 19:25:31.288574] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.521 [2024-04-24 19:25:31.288619] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.288651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.288685] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.288715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.521 [2024-04-24 19:25:31.288749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.521 [2024-04-24 19:25:31.288780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.288812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.288843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.290912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.522 [2024-04-24 19:25:31.290953] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:18:44.522 [2024-04-24 19:25:31.290966] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.290985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.290999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.291014] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.291028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.291042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.291059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.291073] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.291087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.292942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.522 [2024-04-24 19:25:31.292983] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:18:44.522 [2024-04-24 19:25:31.293014] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.293058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.293091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.293123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.293154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.293186] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.293200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.293214] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.293227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.295043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.522 [2024-04-24 19:25:31.295083] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:18:44.522 [2024-04-24 19:25:31.295113] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.295155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.295187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.295220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.295252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.295285] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.295315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.295348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:44.522 [2024-04-24 19:25:31.295378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:1424 cdw0:0 sqhd:2200 p:0 m:1 dnr:0 00:18:44.522 [2024-04-24 19:25:31.315614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:44.522 [2024-04-24 19:25:31.315672] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:18:44.522 [2024-04-24 19:25:31.315685] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.323936] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:44.522 [2024-04-24 19:25:31.323965] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:18:44.522 [2024-04-24 19:25:31.323976] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:18:44.522 [2024-04-24 19:25:31.324021] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324036] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324048] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324060] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324070] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324093] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:44.522 [2024-04-24 19:25:31.324175] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:18:44.522 [2024-04-24 19:25:31.324188] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:18:44.522 [2024-04-24 19:25:31.324197] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:18:44.522 [2024-04-24 19:25:31.324211] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:18:44.522 [2024-04-24 19:25:31.326460] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:18:44.522 task offset: 40960 on job bdev=Nvme7n1 fails 00:18:44.522 00:18:44.522 Latency(us) 00:18:44.522 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:44.522 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme1n1 ended in about 1.89 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme1n1 : 1.89 135.10 8.44 33.77 0.00 376928.17 24846.69 1064988.49 00:18:44.522 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme2n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme2n1 : 1.90 135.57 8.47 33.76 0.00 372983.32 6411.13 1064988.49 00:18:44.522 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme3n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme3n1 : 1.90 134.98 8.44 33.74 0.00 371212.29 30089.57 1064988.49 00:18:44.522 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme4n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme4n1 : 1.90 150.73 9.42 33.73 0.00 336639.14 5584.81 1064988.49 00:18:44.522 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme5n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme5n1 : 1.90 143.29 8.96 33.72 0.00 347857.08 9004.08 1064988.49 00:18:44.522 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme6n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme6n1 : 1.90 134.80 8.43 33.70 0.00 362290.49 46730.02 1064988.49 00:18:44.522 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme7n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme7n1 : 1.90 143.17 8.95 33.69 0.00 341864.54 16982.37 1064988.49 00:18:44.522 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme8n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme8n1 : 1.90 134.69 8.42 33.67 0.00 356510.14 19831.76 1137932.91 00:18:44.522 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme9n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme9n1 : 1.90 134.63 8.41 33.66 0.00 353532.88 50833.14 1123344.03 00:18:44.522 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:44.522 Job: Nvme10n1 ended in about 1.90 seconds with error 00:18:44.522 Verification LBA range: start 0x0 length 0x400 00:18:44.522 Nvme10n1 : 1.90 134.58 8.41 33.64 0.00 350247.18 34876.55 1101460.70 00:18:44.522 =================================================================================================================== 00:18:44.522 Total : 1381.54 86.35 337.09 0.00 356705.05 5584.81 1137932.91 00:18:44.522 [2024-04-24 19:25:31.347733] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:18:44.522 [2024-04-24 19:25:31.347761] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:18:44.522 [2024-04-24 19:25:31.347776] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:18:44.522 [2024-04-24 19:25:31.357588] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.522 [2024-04-24 19:25:31.357649] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.522 [2024-04-24 19:25:31.357679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:44.523 [2024-04-24 19:25:31.357820] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.357836] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.357847] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:18:44.523 [2024-04-24 19:25:31.357942] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.357956] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.357967] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:18:44.523 [2024-04-24 19:25:31.361245] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.361298] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.361325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:18:44.523 [2024-04-24 19:25:31.361450] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.361485] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.361510] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:18:44.523 [2024-04-24 19:25:31.361666] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.361708] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.361734] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:18:44.523 [2024-04-24 19:25:31.361862] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.361896] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.361924] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:18:44.523 [2024-04-24 19:25:31.362638] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.362656] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.362667] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:18:44.523 [2024-04-24 19:25:31.362776] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.362790] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.362801] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:18:44.523 [2024-04-24 19:25:31.362895] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:44.523 [2024-04-24 19:25:31.362910] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:44.523 [2024-04-24 19:25:31.362921] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:18:44.782 19:25:31 -- target/shutdown.sh@142 -- # kill -9 3056829 00:18:44.782 19:25:31 -- target/shutdown.sh@144 -- # stoptarget 00:18:44.782 19:25:31 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:44.782 19:25:31 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:44.782 19:25:31 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:44.782 19:25:31 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:44.782 19:25:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:44.782 19:25:31 -- nvmf/common.sh@117 -- # sync 00:18:44.782 19:25:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:44.782 19:25:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:44.782 19:25:31 -- nvmf/common.sh@120 -- # set +e 00:18:44.782 19:25:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:44.782 19:25:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:44.782 rmmod nvme_rdma 00:18:44.782 rmmod nvme_fabrics 00:18:44.782 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 3056829 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:18:44.782 19:25:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:44.782 19:25:31 -- nvmf/common.sh@124 -- # set -e 00:18:44.782 19:25:31 -- nvmf/common.sh@125 -- # return 0 00:18:44.782 19:25:31 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:44.782 19:25:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:44.782 19:25:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:44.782 00:18:44.782 real 0m5.361s 00:18:44.782 user 0m18.102s 00:18:44.782 sys 0m1.399s 00:18:44.782 19:25:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:44.782 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:18:44.782 ************************************ 00:18:44.782 END TEST nvmf_shutdown_tc3 00:18:44.782 ************************************ 00:18:45.042 19:25:31 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:18:45.042 00:18:45.042 real 0m24.423s 00:18:45.042 user 1m12.970s 00:18:45.042 sys 0m8.423s 00:18:45.042 19:25:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:45.042 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.042 ************************************ 00:18:45.042 END TEST nvmf_shutdown 00:18:45.042 ************************************ 00:18:45.042 19:25:31 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:18:45.042 19:25:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:45.042 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.042 19:25:31 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:18:45.042 19:25:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:45.042 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.042 19:25:31 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:18:45.042 19:25:31 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:18:45.042 19:25:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.042 19:25:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.042 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.042 ************************************ 00:18:45.042 START TEST nvmf_multicontroller 00:18:45.042 ************************************ 00:18:45.302 19:25:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:18:45.302 * Looking for test storage... 00:18:45.302 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:45.302 19:25:32 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.302 19:25:32 -- nvmf/common.sh@7 -- # uname -s 00:18:45.302 19:25:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.302 19:25:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.302 19:25:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.302 19:25:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.302 19:25:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.302 19:25:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.302 19:25:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.302 19:25:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.302 19:25:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.302 19:25:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.302 19:25:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:18:45.302 19:25:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:18:45.302 19:25:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.302 19:25:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.302 19:25:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.302 19:25:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:45.302 19:25:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:45.302 19:25:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.302 19:25:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.302 19:25:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.302 19:25:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.302 19:25:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.302 19:25:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.302 19:25:32 -- paths/export.sh@5 -- # export PATH 00:18:45.302 19:25:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.302 19:25:32 -- nvmf/common.sh@47 -- # : 0 00:18:45.302 19:25:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:45.302 19:25:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:45.302 19:25:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:45.302 19:25:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.302 19:25:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.302 19:25:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:45.302 19:25:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:45.302 19:25:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:45.302 19:25:32 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:45.302 19:25:32 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:45.302 19:25:32 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:18:45.302 19:25:32 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:18:45.302 19:25:32 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:45.302 19:25:32 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:18:45.302 19:25:32 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:18:45.302 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:18:45.302 19:25:32 -- host/multicontroller.sh@20 -- # exit 0 00:18:45.302 00:18:45.302 real 0m0.135s 00:18:45.302 user 0m0.060s 00:18:45.302 sys 0m0.086s 00:18:45.302 19:25:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:45.302 19:25:32 -- common/autotest_common.sh@10 -- # set +x 00:18:45.302 ************************************ 00:18:45.302 END TEST nvmf_multicontroller 00:18:45.302 ************************************ 00:18:45.303 19:25:32 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:18:45.303 19:25:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.303 19:25:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.303 19:25:32 -- common/autotest_common.sh@10 -- # set +x 00:18:45.561 ************************************ 00:18:45.561 START TEST nvmf_aer 00:18:45.561 ************************************ 00:18:45.561 19:25:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:18:45.561 * Looking for test storage... 00:18:45.561 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:45.561 19:25:32 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.561 19:25:32 -- nvmf/common.sh@7 -- # uname -s 00:18:45.561 19:25:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.561 19:25:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.561 19:25:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.561 19:25:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.561 19:25:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.561 19:25:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.561 19:25:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.561 19:25:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.561 19:25:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.561 19:25:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.561 19:25:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:18:45.562 19:25:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:18:45.562 19:25:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.562 19:25:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.562 19:25:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.562 19:25:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:45.562 19:25:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:45.562 19:25:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.562 19:25:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.562 19:25:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.562 19:25:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.562 19:25:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.562 19:25:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.562 19:25:32 -- paths/export.sh@5 -- # export PATH 00:18:45.562 19:25:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.562 19:25:32 -- nvmf/common.sh@47 -- # : 0 00:18:45.562 19:25:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:45.562 19:25:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:45.562 19:25:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:45.562 19:25:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.562 19:25:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.562 19:25:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:45.562 19:25:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:45.562 19:25:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:45.562 19:25:32 -- host/aer.sh@11 -- # nvmftestinit 00:18:45.562 19:25:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:45.562 19:25:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.562 19:25:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:45.562 19:25:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:45.562 19:25:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:45.562 19:25:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.562 19:25:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.562 19:25:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.562 19:25:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:45.562 19:25:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:45.562 19:25:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:45.562 19:25:32 -- common/autotest_common.sh@10 -- # set +x 00:18:50.831 19:25:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:50.831 19:25:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:50.831 19:25:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:50.831 19:25:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:50.831 19:25:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:50.831 19:25:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:50.831 19:25:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:50.831 19:25:37 -- nvmf/common.sh@295 -- # net_devs=() 00:18:50.831 19:25:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:50.831 19:25:37 -- nvmf/common.sh@296 -- # e810=() 00:18:50.831 19:25:37 -- nvmf/common.sh@296 -- # local -ga e810 00:18:50.831 19:25:37 -- nvmf/common.sh@297 -- # x722=() 00:18:50.831 19:25:37 -- nvmf/common.sh@297 -- # local -ga x722 00:18:50.831 19:25:37 -- nvmf/common.sh@298 -- # mlx=() 00:18:50.831 19:25:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:50.831 19:25:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:50.831 19:25:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:50.831 19:25:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:50.831 19:25:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:50.831 19:25:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:50.831 19:25:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:50.831 19:25:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:50.831 19:25:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:50.831 19:25:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:50.831 19:25:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:50.831 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:50.831 19:25:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:50.831 19:25:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:50.831 19:25:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:50.832 19:25:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:50.832 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:50.832 19:25:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:50.832 19:25:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.832 19:25:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.832 19:25:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:50.832 Found net devices under 0000:18:00.0: mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.832 19:25:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.832 19:25:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.832 19:25:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:50.832 Found net devices under 0000:18:00.1: mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.832 19:25:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:50.832 19:25:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:50.832 19:25:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:50.832 19:25:37 -- nvmf/common.sh@58 -- # uname 00:18:50.832 19:25:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:50.832 19:25:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:50.832 19:25:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:50.832 19:25:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:50.832 19:25:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:50.832 19:25:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:50.832 19:25:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:50.832 19:25:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:50.832 19:25:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:50.832 19:25:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:50.832 19:25:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:50.832 19:25:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:50.832 19:25:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:50.832 19:25:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:50.832 19:25:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:50.832 19:25:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@105 -- # continue 2 00:18:50.832 19:25:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@105 -- # continue 2 00:18:50.832 19:25:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:50.832 19:25:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:50.832 19:25:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:50.832 19:25:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:50.832 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:50.832 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:18:50.832 altname enp24s0f0np0 00:18:50.832 altname ens785f0np0 00:18:50.832 inet 192.168.100.8/24 scope global mlx_0_0 00:18:50.832 valid_lft forever preferred_lft forever 00:18:50.832 19:25:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:50.832 19:25:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:50.832 19:25:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:50.832 19:25:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:50.832 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:50.832 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:18:50.832 altname enp24s0f1np1 00:18:50.832 altname ens785f1np1 00:18:50.832 inet 192.168.100.9/24 scope global mlx_0_1 00:18:50.832 valid_lft forever preferred_lft forever 00:18:50.832 19:25:37 -- nvmf/common.sh@411 -- # return 0 00:18:50.832 19:25:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:50.832 19:25:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:50.832 19:25:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:50.832 19:25:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:50.832 19:25:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:50.832 19:25:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:50.832 19:25:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:50.832 19:25:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:50.832 19:25:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:50.832 19:25:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@105 -- # continue 2 00:18:50.832 19:25:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:50.832 19:25:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:50.832 19:25:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:50.832 19:25:37 -- nvmf/common.sh@105 -- # continue 2 00:18:50.832 19:25:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:50.832 19:25:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:50.832 19:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.091 19:25:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:51.091 19:25:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:51.091 19:25:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:51.091 19:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:51.091 19:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.091 19:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.091 19:25:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:51.091 192.168.100.9' 00:18:51.091 19:25:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:51.091 192.168.100.9' 00:18:51.091 19:25:37 -- nvmf/common.sh@446 -- # head -n 1 00:18:51.091 19:25:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:51.092 19:25:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:51.092 192.168.100.9' 00:18:51.092 19:25:37 -- nvmf/common.sh@447 -- # head -n 1 00:18:51.092 19:25:37 -- nvmf/common.sh@447 -- # tail -n +2 00:18:51.092 19:25:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:51.092 19:25:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:51.092 19:25:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:51.092 19:25:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:51.092 19:25:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:51.092 19:25:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:51.092 19:25:37 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:18:51.092 19:25:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:51.092 19:25:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:51.092 19:25:37 -- common/autotest_common.sh@10 -- # set +x 00:18:51.092 19:25:37 -- nvmf/common.sh@470 -- # nvmfpid=3060212 00:18:51.092 19:25:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:51.092 19:25:37 -- nvmf/common.sh@471 -- # waitforlisten 3060212 00:18:51.092 19:25:37 -- common/autotest_common.sh@817 -- # '[' -z 3060212 ']' 00:18:51.092 19:25:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:51.092 19:25:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:51.092 19:25:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:51.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:51.092 19:25:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:51.092 19:25:37 -- common/autotest_common.sh@10 -- # set +x 00:18:51.092 [2024-04-24 19:25:37.959963] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:51.092 [2024-04-24 19:25:37.960026] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:51.092 EAL: No free 2048 kB hugepages reported on node 1 00:18:51.092 [2024-04-24 19:25:38.032890] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:51.351 [2024-04-24 19:25:38.118832] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:51.351 [2024-04-24 19:25:38.118873] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:51.351 [2024-04-24 19:25:38.118882] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:51.351 [2024-04-24 19:25:38.118906] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:51.351 [2024-04-24 19:25:38.118914] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:51.351 [2024-04-24 19:25:38.118967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:51.351 [2024-04-24 19:25:38.119067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:51.351 [2024-04-24 19:25:38.119133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:51.351 [2024-04-24 19:25:38.119135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:51.952 19:25:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:51.952 19:25:38 -- common/autotest_common.sh@850 -- # return 0 00:18:51.952 19:25:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:51.952 19:25:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:51.952 19:25:38 -- common/autotest_common.sh@10 -- # set +x 00:18:51.952 19:25:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:51.952 19:25:38 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:51.952 19:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:51.952 19:25:38 -- common/autotest_common.sh@10 -- # set +x 00:18:51.952 [2024-04-24 19:25:38.860773] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x16bf240/0x16c3730) succeed. 00:18:51.952 [2024-04-24 19:25:38.871400] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x16c0880/0x1704dc0) succeed. 00:18:52.211 19:25:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:38 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:18:52.211 19:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.211 19:25:38 -- common/autotest_common.sh@10 -- # set +x 00:18:52.211 Malloc0 00:18:52.211 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:39 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:18:52.211 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.211 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.211 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:39 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:52.211 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.211 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.211 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:39 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:52.211 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.211 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.211 [2024-04-24 19:25:39.040775] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:52.211 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:39 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:18:52.211 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.211 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.211 [2024-04-24 19:25:39.048410] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:18:52.211 [ 00:18:52.211 { 00:18:52.211 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:18:52.211 "subtype": "Discovery", 00:18:52.211 "listen_addresses": [], 00:18:52.211 "allow_any_host": true, 00:18:52.211 "hosts": [] 00:18:52.211 }, 00:18:52.211 { 00:18:52.211 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:52.211 "subtype": "NVMe", 00:18:52.211 "listen_addresses": [ 00:18:52.211 { 00:18:52.211 "transport": "RDMA", 00:18:52.211 "trtype": "RDMA", 00:18:52.211 "adrfam": "IPv4", 00:18:52.211 "traddr": "192.168.100.8", 00:18:52.211 "trsvcid": "4420" 00:18:52.211 } 00:18:52.211 ], 00:18:52.211 "allow_any_host": true, 00:18:52.211 "hosts": [], 00:18:52.211 "serial_number": "SPDK00000000000001", 00:18:52.211 "model_number": "SPDK bdev Controller", 00:18:52.211 "max_namespaces": 2, 00:18:52.211 "min_cntlid": 1, 00:18:52.211 "max_cntlid": 65519, 00:18:52.211 "namespaces": [ 00:18:52.211 { 00:18:52.211 "nsid": 1, 00:18:52.211 "bdev_name": "Malloc0", 00:18:52.211 "name": "Malloc0", 00:18:52.211 "nguid": "40FB95F739924385B2AC95F141F21548", 00:18:52.211 "uuid": "40fb95f7-3992-4385-b2ac-95f141f21548" 00:18:52.211 } 00:18:52.211 ] 00:18:52.211 } 00:18:52.211 ] 00:18:52.211 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.211 19:25:39 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:18:52.211 19:25:39 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:18:52.211 19:25:39 -- host/aer.sh@33 -- # aerpid=3060413 00:18:52.211 19:25:39 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:18:52.211 19:25:39 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:18:52.211 19:25:39 -- common/autotest_common.sh@1251 -- # local i=0 00:18:52.211 19:25:39 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:18:52.211 19:25:39 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:18:52.211 19:25:39 -- common/autotest_common.sh@1254 -- # i=1 00:18:52.211 19:25:39 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:18:52.211 EAL: No free 2048 kB hugepages reported on node 1 00:18:52.211 19:25:39 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:18:52.211 19:25:39 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:18:52.211 19:25:39 -- common/autotest_common.sh@1254 -- # i=2 00:18:52.211 19:25:39 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:18:52.470 19:25:39 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:18:52.470 19:25:39 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:18:52.470 19:25:39 -- common/autotest_common.sh@1262 -- # return 0 00:18:52.470 19:25:39 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:18:52.470 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.470 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.470 Malloc1 00:18:52.470 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.470 19:25:39 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:18:52.470 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.470 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.470 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.470 19:25:39 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:18:52.470 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.470 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.470 [ 00:18:52.470 { 00:18:52.470 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:18:52.470 "subtype": "Discovery", 00:18:52.470 "listen_addresses": [], 00:18:52.470 "allow_any_host": true, 00:18:52.470 "hosts": [] 00:18:52.470 }, 00:18:52.470 { 00:18:52.470 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:52.470 "subtype": "NVMe", 00:18:52.470 "listen_addresses": [ 00:18:52.470 { 00:18:52.470 "transport": "RDMA", 00:18:52.470 "trtype": "RDMA", 00:18:52.470 "adrfam": "IPv4", 00:18:52.470 "traddr": "192.168.100.8", 00:18:52.470 "trsvcid": "4420" 00:18:52.470 } 00:18:52.470 ], 00:18:52.470 "allow_any_host": true, 00:18:52.470 "hosts": [], 00:18:52.470 "serial_number": "SPDK00000000000001", 00:18:52.470 "model_number": "SPDK bdev Controller", 00:18:52.470 "max_namespaces": 2, 00:18:52.470 "min_cntlid": 1, 00:18:52.470 "max_cntlid": 65519, 00:18:52.470 "namespaces": [ 00:18:52.470 { 00:18:52.470 "nsid": 1, 00:18:52.470 "bdev_name": "Malloc0", 00:18:52.470 "name": "Malloc0", 00:18:52.470 "nguid": "40FB95F739924385B2AC95F141F21548", 00:18:52.470 "uuid": "40fb95f7-3992-4385-b2ac-95f141f21548" 00:18:52.470 }, 00:18:52.470 { 00:18:52.470 "nsid": 2, 00:18:52.470 "bdev_name": "Malloc1", 00:18:52.470 "name": "Malloc1", 00:18:52.470 "nguid": "B4D4E4325677476F99462C93D51212EB", 00:18:52.470 "uuid": "b4d4e432-5677-476f-9946-2c93d51212eb" 00:18:52.470 } 00:18:52.470 ] 00:18:52.470 } 00:18:52.470 ] 00:18:52.470 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.470 19:25:39 -- host/aer.sh@43 -- # wait 3060413 00:18:52.471 Asynchronous Event Request test 00:18:52.471 Attaching to 192.168.100.8 00:18:52.471 Attached to 192.168.100.8 00:18:52.471 Registering asynchronous event callbacks... 00:18:52.471 Starting namespace attribute notice tests for all controllers... 00:18:52.471 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:18:52.471 aer_cb - Changed Namespace 00:18:52.471 Cleaning up... 00:18:52.471 19:25:39 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:18:52.471 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.471 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.471 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.471 19:25:39 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:18:52.471 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.471 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.471 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.471 19:25:39 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:52.471 19:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:52.471 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.471 19:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:52.471 19:25:39 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:18:52.471 19:25:39 -- host/aer.sh@51 -- # nvmftestfini 00:18:52.471 19:25:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:52.471 19:25:39 -- nvmf/common.sh@117 -- # sync 00:18:52.471 19:25:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:52.471 19:25:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:52.471 19:25:39 -- nvmf/common.sh@120 -- # set +e 00:18:52.471 19:25:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:52.471 19:25:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:52.471 rmmod nvme_rdma 00:18:52.471 rmmod nvme_fabrics 00:18:52.730 19:25:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:52.730 19:25:39 -- nvmf/common.sh@124 -- # set -e 00:18:52.730 19:25:39 -- nvmf/common.sh@125 -- # return 0 00:18:52.730 19:25:39 -- nvmf/common.sh@478 -- # '[' -n 3060212 ']' 00:18:52.730 19:25:39 -- nvmf/common.sh@479 -- # killprocess 3060212 00:18:52.730 19:25:39 -- common/autotest_common.sh@936 -- # '[' -z 3060212 ']' 00:18:52.730 19:25:39 -- common/autotest_common.sh@940 -- # kill -0 3060212 00:18:52.730 19:25:39 -- common/autotest_common.sh@941 -- # uname 00:18:52.730 19:25:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.730 19:25:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3060212 00:18:52.730 19:25:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:52.730 19:25:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:52.730 19:25:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3060212' 00:18:52.730 killing process with pid 3060212 00:18:52.730 19:25:39 -- common/autotest_common.sh@955 -- # kill 3060212 00:18:52.730 [2024-04-24 19:25:39.561727] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:18:52.730 19:25:39 -- common/autotest_common.sh@960 -- # wait 3060212 00:18:52.730 [2024-04-24 19:25:39.648911] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:52.989 19:25:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:52.989 19:25:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:52.989 00:18:52.989 real 0m7.481s 00:18:52.989 user 0m8.300s 00:18:52.989 sys 0m4.631s 00:18:52.989 19:25:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:52.989 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:52.989 ************************************ 00:18:52.989 END TEST nvmf_aer 00:18:52.989 ************************************ 00:18:52.989 19:25:39 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:18:52.989 19:25:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:52.989 19:25:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:52.989 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:18:53.248 ************************************ 00:18:53.248 START TEST nvmf_async_init 00:18:53.248 ************************************ 00:18:53.248 19:25:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:18:53.248 * Looking for test storage... 00:18:53.248 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:53.248 19:25:40 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:53.248 19:25:40 -- nvmf/common.sh@7 -- # uname -s 00:18:53.248 19:25:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:53.248 19:25:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:53.248 19:25:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:53.248 19:25:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:53.248 19:25:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:53.248 19:25:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:53.248 19:25:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:53.248 19:25:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:53.248 19:25:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:53.248 19:25:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:53.248 19:25:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:18:53.248 19:25:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:18:53.248 19:25:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:53.248 19:25:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:53.248 19:25:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:53.248 19:25:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:53.248 19:25:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:53.248 19:25:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:53.248 19:25:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:53.248 19:25:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:53.248 19:25:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.248 19:25:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.248 19:25:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.248 19:25:40 -- paths/export.sh@5 -- # export PATH 00:18:53.248 19:25:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.248 19:25:40 -- nvmf/common.sh@47 -- # : 0 00:18:53.248 19:25:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:53.248 19:25:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:53.248 19:25:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:53.248 19:25:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:53.248 19:25:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:53.248 19:25:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:53.248 19:25:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:53.248 19:25:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:53.248 19:25:40 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:18:53.248 19:25:40 -- host/async_init.sh@14 -- # null_block_size=512 00:18:53.248 19:25:40 -- host/async_init.sh@15 -- # null_bdev=null0 00:18:53.248 19:25:40 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:18:53.248 19:25:40 -- host/async_init.sh@20 -- # uuidgen 00:18:53.248 19:25:40 -- host/async_init.sh@20 -- # tr -d - 00:18:53.248 19:25:40 -- host/async_init.sh@20 -- # nguid=ae9d7b1621424228ad55db0364b9dd5b 00:18:53.248 19:25:40 -- host/async_init.sh@22 -- # nvmftestinit 00:18:53.248 19:25:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:53.248 19:25:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:53.248 19:25:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:53.248 19:25:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:53.248 19:25:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:53.248 19:25:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.248 19:25:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.248 19:25:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.249 19:25:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:53.249 19:25:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:53.249 19:25:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:53.249 19:25:40 -- common/autotest_common.sh@10 -- # set +x 00:18:59.822 19:25:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:59.822 19:25:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:59.822 19:25:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:59.822 19:25:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:59.822 19:25:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:59.822 19:25:46 -- nvmf/common.sh@295 -- # net_devs=() 00:18:59.822 19:25:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@296 -- # e810=() 00:18:59.822 19:25:46 -- nvmf/common.sh@296 -- # local -ga e810 00:18:59.822 19:25:46 -- nvmf/common.sh@297 -- # x722=() 00:18:59.822 19:25:46 -- nvmf/common.sh@297 -- # local -ga x722 00:18:59.822 19:25:46 -- nvmf/common.sh@298 -- # mlx=() 00:18:59.822 19:25:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:59.822 19:25:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:59.822 19:25:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:59.822 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:59.822 19:25:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:59.822 19:25:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:59.822 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:59.822 19:25:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:59.822 19:25:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.822 19:25:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.822 19:25:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:59.822 Found net devices under 0000:18:00.0: mlx_0_0 00:18:59.822 19:25:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:59.822 19:25:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:59.822 19:25:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:59.822 Found net devices under 0000:18:00.1: mlx_0_1 00:18:59.822 19:25:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:59.822 19:25:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:59.822 19:25:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:59.822 19:25:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:59.822 19:25:46 -- nvmf/common.sh@58 -- # uname 00:18:59.822 19:25:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:59.822 19:25:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:59.822 19:25:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:59.822 19:25:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:59.822 19:25:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:59.822 19:25:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:59.822 19:25:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:59.822 19:25:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:59.822 19:25:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:59.822 19:25:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:59.822 19:25:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:59.822 19:25:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:59.822 19:25:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:59.822 19:25:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:59.822 19:25:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:59.822 19:25:46 -- nvmf/common.sh@105 -- # continue 2 00:18:59.822 19:25:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.822 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:59.822 19:25:46 -- nvmf/common.sh@105 -- # continue 2 00:18:59.822 19:25:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:59.822 19:25:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:59.822 19:25:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:59.822 19:25:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:59.822 19:25:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:59.822 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:59.822 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:18:59.822 altname enp24s0f0np0 00:18:59.822 altname ens785f0np0 00:18:59.822 inet 192.168.100.8/24 scope global mlx_0_0 00:18:59.822 valid_lft forever preferred_lft forever 00:18:59.822 19:25:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:59.822 19:25:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:59.822 19:25:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:59.822 19:25:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:59.822 19:25:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:59.822 19:25:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:59.822 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:59.822 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:18:59.822 altname enp24s0f1np1 00:18:59.822 altname ens785f1np1 00:18:59.822 inet 192.168.100.9/24 scope global mlx_0_1 00:18:59.822 valid_lft forever preferred_lft forever 00:18:59.822 19:25:46 -- nvmf/common.sh@411 -- # return 0 00:18:59.822 19:25:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:59.822 19:25:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:59.822 19:25:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:59.822 19:25:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:59.822 19:25:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:59.822 19:25:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:59.822 19:25:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:59.823 19:25:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:59.823 19:25:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:59.823 19:25:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:59.823 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.823 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:59.823 19:25:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:59.823 19:25:46 -- nvmf/common.sh@105 -- # continue 2 00:18:59.823 19:25:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:59.823 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.823 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:59.823 19:25:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:59.823 19:25:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:59.823 19:25:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:59.823 19:25:46 -- nvmf/common.sh@105 -- # continue 2 00:18:59.823 19:25:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:59.823 19:25:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:59.823 19:25:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:59.823 19:25:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:59.823 19:25:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:59.823 19:25:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:59.823 19:25:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:59.823 19:25:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:59.823 192.168.100.9' 00:18:59.823 19:25:46 -- nvmf/common.sh@446 -- # head -n 1 00:18:59.823 19:25:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:59.823 192.168.100.9' 00:18:59.823 19:25:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:59.823 19:25:46 -- nvmf/common.sh@447 -- # tail -n +2 00:18:59.823 19:25:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:59.823 192.168.100.9' 00:18:59.823 19:25:46 -- nvmf/common.sh@447 -- # head -n 1 00:18:59.823 19:25:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:59.823 19:25:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:59.823 19:25:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:59.823 19:25:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:59.823 19:25:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:59.823 19:25:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:59.823 19:25:46 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:18:59.823 19:25:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:59.823 19:25:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:59.823 19:25:46 -- common/autotest_common.sh@10 -- # set +x 00:18:59.823 19:25:46 -- nvmf/common.sh@470 -- # nvmfpid=3063323 00:18:59.823 19:25:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:59.823 19:25:46 -- nvmf/common.sh@471 -- # waitforlisten 3063323 00:18:59.823 19:25:46 -- common/autotest_common.sh@817 -- # '[' -z 3063323 ']' 00:18:59.823 19:25:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:59.823 19:25:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:59.823 19:25:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:59.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:59.823 19:25:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:59.823 19:25:46 -- common/autotest_common.sh@10 -- # set +x 00:18:59.823 [2024-04-24 19:25:46.327637] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:18:59.823 [2024-04-24 19:25:46.327696] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:59.823 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.823 [2024-04-24 19:25:46.399819] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.823 [2024-04-24 19:25:46.483513] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:59.823 [2024-04-24 19:25:46.483562] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:59.823 [2024-04-24 19:25:46.483572] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:59.823 [2024-04-24 19:25:46.483596] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:59.823 [2024-04-24 19:25:46.483604] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:59.823 [2024-04-24 19:25:46.483632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:00.392 19:25:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:00.392 19:25:47 -- common/autotest_common.sh@850 -- # return 0 00:19:00.392 19:25:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:00.392 19:25:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:00.392 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.392 19:25:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:00.392 19:25:47 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:19:00.392 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.392 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.392 [2024-04-24 19:25:47.205475] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xfdf0e0/0xfe35d0) succeed. 00:19:00.392 [2024-04-24 19:25:47.214598] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xfe05e0/0x1024c60) succeed. 00:19:00.392 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.392 19:25:47 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:19:00.392 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.392 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.392 null0 00:19:00.392 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.392 19:25:47 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:19:00.392 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ae9d7b1621424228ad55db0364b9dd5b 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 [2024-04-24 19:25:47.293982] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 nvme0n1 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 [ 00:19:00.393 { 00:19:00.393 "name": "nvme0n1", 00:19:00.393 "aliases": [ 00:19:00.393 "ae9d7b16-2142-4228-ad55-db0364b9dd5b" 00:19:00.393 ], 00:19:00.393 "product_name": "NVMe disk", 00:19:00.393 "block_size": 512, 00:19:00.393 "num_blocks": 2097152, 00:19:00.393 "uuid": "ae9d7b16-2142-4228-ad55-db0364b9dd5b", 00:19:00.393 "assigned_rate_limits": { 00:19:00.393 "rw_ios_per_sec": 0, 00:19:00.393 "rw_mbytes_per_sec": 0, 00:19:00.393 "r_mbytes_per_sec": 0, 00:19:00.393 "w_mbytes_per_sec": 0 00:19:00.393 }, 00:19:00.393 "claimed": false, 00:19:00.393 "zoned": false, 00:19:00.393 "supported_io_types": { 00:19:00.393 "read": true, 00:19:00.393 "write": true, 00:19:00.393 "unmap": false, 00:19:00.393 "write_zeroes": true, 00:19:00.393 "flush": true, 00:19:00.393 "reset": true, 00:19:00.393 "compare": true, 00:19:00.393 "compare_and_write": true, 00:19:00.393 "abort": true, 00:19:00.393 "nvme_admin": true, 00:19:00.393 "nvme_io": true 00:19:00.393 }, 00:19:00.393 "memory_domains": [ 00:19:00.393 { 00:19:00.393 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:00.393 "dma_device_type": 0 00:19:00.393 } 00:19:00.393 ], 00:19:00.393 "driver_specific": { 00:19:00.393 "nvme": [ 00:19:00.393 { 00:19:00.393 "trid": { 00:19:00.393 "trtype": "RDMA", 00:19:00.393 "adrfam": "IPv4", 00:19:00.393 "traddr": "192.168.100.8", 00:19:00.393 "trsvcid": "4420", 00:19:00.393 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:00.393 }, 00:19:00.393 "ctrlr_data": { 00:19:00.393 "cntlid": 1, 00:19:00.393 "vendor_id": "0x8086", 00:19:00.393 "model_number": "SPDK bdev Controller", 00:19:00.393 "serial_number": "00000000000000000000", 00:19:00.393 "firmware_revision": "24.05", 00:19:00.393 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:00.393 "oacs": { 00:19:00.393 "security": 0, 00:19:00.393 "format": 0, 00:19:00.393 "firmware": 0, 00:19:00.393 "ns_manage": 0 00:19:00.393 }, 00:19:00.393 "multi_ctrlr": true, 00:19:00.393 "ana_reporting": false 00:19:00.393 }, 00:19:00.393 "vs": { 00:19:00.393 "nvme_version": "1.3" 00:19:00.393 }, 00:19:00.393 "ns_data": { 00:19:00.393 "id": 1, 00:19:00.393 "can_share": true 00:19:00.393 } 00:19:00.393 } 00:19:00.393 ], 00:19:00.393 "mp_policy": "active_passive" 00:19:00.393 } 00:19:00.393 } 00:19:00.393 ] 00:19:00.393 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.393 19:25:47 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:19:00.393 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.393 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.393 [2024-04-24 19:25:47.403794] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:00.664 [2024-04-24 19:25:47.426474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:00.664 [2024-04-24 19:25:47.447906] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:00.664 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.664 19:25:47 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:00.664 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.664 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.664 [ 00:19:00.664 { 00:19:00.664 "name": "nvme0n1", 00:19:00.664 "aliases": [ 00:19:00.664 "ae9d7b16-2142-4228-ad55-db0364b9dd5b" 00:19:00.664 ], 00:19:00.664 "product_name": "NVMe disk", 00:19:00.664 "block_size": 512, 00:19:00.664 "num_blocks": 2097152, 00:19:00.664 "uuid": "ae9d7b16-2142-4228-ad55-db0364b9dd5b", 00:19:00.664 "assigned_rate_limits": { 00:19:00.664 "rw_ios_per_sec": 0, 00:19:00.664 "rw_mbytes_per_sec": 0, 00:19:00.664 "r_mbytes_per_sec": 0, 00:19:00.664 "w_mbytes_per_sec": 0 00:19:00.664 }, 00:19:00.664 "claimed": false, 00:19:00.664 "zoned": false, 00:19:00.664 "supported_io_types": { 00:19:00.664 "read": true, 00:19:00.664 "write": true, 00:19:00.664 "unmap": false, 00:19:00.664 "write_zeroes": true, 00:19:00.664 "flush": true, 00:19:00.664 "reset": true, 00:19:00.664 "compare": true, 00:19:00.664 "compare_and_write": true, 00:19:00.664 "abort": true, 00:19:00.664 "nvme_admin": true, 00:19:00.664 "nvme_io": true 00:19:00.664 }, 00:19:00.664 "memory_domains": [ 00:19:00.664 { 00:19:00.664 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:00.664 "dma_device_type": 0 00:19:00.664 } 00:19:00.664 ], 00:19:00.664 "driver_specific": { 00:19:00.664 "nvme": [ 00:19:00.664 { 00:19:00.664 "trid": { 00:19:00.664 "trtype": "RDMA", 00:19:00.665 "adrfam": "IPv4", 00:19:00.665 "traddr": "192.168.100.8", 00:19:00.665 "trsvcid": "4420", 00:19:00.665 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:00.665 }, 00:19:00.665 "ctrlr_data": { 00:19:00.665 "cntlid": 2, 00:19:00.665 "vendor_id": "0x8086", 00:19:00.665 "model_number": "SPDK bdev Controller", 00:19:00.665 "serial_number": "00000000000000000000", 00:19:00.665 "firmware_revision": "24.05", 00:19:00.665 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:00.665 "oacs": { 00:19:00.665 "security": 0, 00:19:00.665 "format": 0, 00:19:00.665 "firmware": 0, 00:19:00.665 "ns_manage": 0 00:19:00.665 }, 00:19:00.665 "multi_ctrlr": true, 00:19:00.665 "ana_reporting": false 00:19:00.665 }, 00:19:00.665 "vs": { 00:19:00.665 "nvme_version": "1.3" 00:19:00.665 }, 00:19:00.665 "ns_data": { 00:19:00.665 "id": 1, 00:19:00.665 "can_share": true 00:19:00.665 } 00:19:00.665 } 00:19:00.665 ], 00:19:00.665 "mp_policy": "active_passive" 00:19:00.665 } 00:19:00.665 } 00:19:00.665 ] 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@53 -- # mktemp 00:19:00.665 19:25:47 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.T1pXQxFGuN 00:19:00.665 19:25:47 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:00.665 19:25:47 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.T1pXQxFGuN 00:19:00.665 19:25:47 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 [2024-04-24 19:25:47.519304] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.T1pXQxFGuN 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.T1pXQxFGuN 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 [2024-04-24 19:25:47.535325] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:00.665 nvme0n1 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 [ 00:19:00.665 { 00:19:00.665 "name": "nvme0n1", 00:19:00.665 "aliases": [ 00:19:00.665 "ae9d7b16-2142-4228-ad55-db0364b9dd5b" 00:19:00.665 ], 00:19:00.665 "product_name": "NVMe disk", 00:19:00.665 "block_size": 512, 00:19:00.665 "num_blocks": 2097152, 00:19:00.665 "uuid": "ae9d7b16-2142-4228-ad55-db0364b9dd5b", 00:19:00.665 "assigned_rate_limits": { 00:19:00.665 "rw_ios_per_sec": 0, 00:19:00.665 "rw_mbytes_per_sec": 0, 00:19:00.665 "r_mbytes_per_sec": 0, 00:19:00.665 "w_mbytes_per_sec": 0 00:19:00.665 }, 00:19:00.665 "claimed": false, 00:19:00.665 "zoned": false, 00:19:00.665 "supported_io_types": { 00:19:00.665 "read": true, 00:19:00.665 "write": true, 00:19:00.665 "unmap": false, 00:19:00.665 "write_zeroes": true, 00:19:00.665 "flush": true, 00:19:00.665 "reset": true, 00:19:00.665 "compare": true, 00:19:00.665 "compare_and_write": true, 00:19:00.665 "abort": true, 00:19:00.665 "nvme_admin": true, 00:19:00.665 "nvme_io": true 00:19:00.665 }, 00:19:00.665 "memory_domains": [ 00:19:00.665 { 00:19:00.665 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:00.665 "dma_device_type": 0 00:19:00.665 } 00:19:00.665 ], 00:19:00.665 "driver_specific": { 00:19:00.665 "nvme": [ 00:19:00.665 { 00:19:00.665 "trid": { 00:19:00.665 "trtype": "RDMA", 00:19:00.665 "adrfam": "IPv4", 00:19:00.665 "traddr": "192.168.100.8", 00:19:00.665 "trsvcid": "4421", 00:19:00.665 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:00.665 }, 00:19:00.665 "ctrlr_data": { 00:19:00.665 "cntlid": 3, 00:19:00.665 "vendor_id": "0x8086", 00:19:00.665 "model_number": "SPDK bdev Controller", 00:19:00.665 "serial_number": "00000000000000000000", 00:19:00.665 "firmware_revision": "24.05", 00:19:00.665 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:00.665 "oacs": { 00:19:00.665 "security": 0, 00:19:00.665 "format": 0, 00:19:00.665 "firmware": 0, 00:19:00.665 "ns_manage": 0 00:19:00.665 }, 00:19:00.665 "multi_ctrlr": true, 00:19:00.665 "ana_reporting": false 00:19:00.665 }, 00:19:00.665 "vs": { 00:19:00.665 "nvme_version": "1.3" 00:19:00.665 }, 00:19:00.665 "ns_data": { 00:19:00.665 "id": 1, 00:19:00.665 "can_share": true 00:19:00.665 } 00:19:00.665 } 00:19:00.665 ], 00:19:00.665 "mp_policy": "active_passive" 00:19:00.665 } 00:19:00.665 } 00:19:00.665 ] 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:00.665 19:25:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:00.665 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:19:00.665 19:25:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:00.665 19:25:47 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.T1pXQxFGuN 00:19:00.665 19:25:47 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:19:00.665 19:25:47 -- host/async_init.sh@78 -- # nvmftestfini 00:19:00.665 19:25:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:00.665 19:25:47 -- nvmf/common.sh@117 -- # sync 00:19:00.665 19:25:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:00.665 19:25:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:00.665 19:25:47 -- nvmf/common.sh@120 -- # set +e 00:19:00.665 19:25:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:00.665 19:25:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:00.665 rmmod nvme_rdma 00:19:01.002 rmmod nvme_fabrics 00:19:01.002 19:25:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:01.002 19:25:47 -- nvmf/common.sh@124 -- # set -e 00:19:01.002 19:25:47 -- nvmf/common.sh@125 -- # return 0 00:19:01.002 19:25:47 -- nvmf/common.sh@478 -- # '[' -n 3063323 ']' 00:19:01.002 19:25:47 -- nvmf/common.sh@479 -- # killprocess 3063323 00:19:01.002 19:25:47 -- common/autotest_common.sh@936 -- # '[' -z 3063323 ']' 00:19:01.002 19:25:47 -- common/autotest_common.sh@940 -- # kill -0 3063323 00:19:01.002 19:25:47 -- common/autotest_common.sh@941 -- # uname 00:19:01.002 19:25:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:01.002 19:25:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3063323 00:19:01.002 19:25:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:01.002 19:25:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:01.002 19:25:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3063323' 00:19:01.002 killing process with pid 3063323 00:19:01.002 19:25:47 -- common/autotest_common.sh@955 -- # kill 3063323 00:19:01.002 19:25:47 -- common/autotest_common.sh@960 -- # wait 3063323 00:19:01.002 [2024-04-24 19:25:47.797118] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:01.287 19:25:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:01.287 19:25:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:01.287 00:19:01.287 real 0m7.934s 00:19:01.287 user 0m3.554s 00:19:01.287 sys 0m5.030s 00:19:01.287 19:25:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:01.287 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:19:01.287 ************************************ 00:19:01.287 END TEST nvmf_async_init 00:19:01.287 ************************************ 00:19:01.287 19:25:48 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:19:01.287 19:25:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:01.287 19:25:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:01.287 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:19:01.287 ************************************ 00:19:01.287 START TEST dma 00:19:01.287 ************************************ 00:19:01.287 19:25:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:19:01.547 * Looking for test storage... 00:19:01.547 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:01.547 19:25:48 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:01.547 19:25:48 -- nvmf/common.sh@7 -- # uname -s 00:19:01.547 19:25:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:01.547 19:25:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:01.547 19:25:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:01.547 19:25:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:01.547 19:25:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:01.547 19:25:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:01.547 19:25:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:01.547 19:25:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:01.547 19:25:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:01.547 19:25:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:01.547 19:25:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:19:01.547 19:25:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:19:01.547 19:25:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:01.547 19:25:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:01.547 19:25:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:01.547 19:25:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:01.547 19:25:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:01.547 19:25:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:01.547 19:25:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:01.547 19:25:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:01.547 19:25:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.548 19:25:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.548 19:25:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.548 19:25:48 -- paths/export.sh@5 -- # export PATH 00:19:01.548 19:25:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.548 19:25:48 -- nvmf/common.sh@47 -- # : 0 00:19:01.548 19:25:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:01.548 19:25:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:01.548 19:25:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:01.548 19:25:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:01.548 19:25:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:01.548 19:25:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:01.548 19:25:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:01.548 19:25:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:01.548 19:25:48 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:19:01.548 19:25:48 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:19:01.548 19:25:48 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:19:01.548 19:25:48 -- host/dma.sh@18 -- # subsystem=0 00:19:01.548 19:25:48 -- host/dma.sh@93 -- # nvmftestinit 00:19:01.548 19:25:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:01.548 19:25:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:01.548 19:25:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:01.548 19:25:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:01.548 19:25:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:01.548 19:25:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.548 19:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.548 19:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.548 19:25:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:01.548 19:25:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:01.548 19:25:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:01.548 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:19:08.119 19:25:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:08.119 19:25:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:08.119 19:25:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:08.119 19:25:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:08.119 19:25:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:08.119 19:25:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:08.119 19:25:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:08.119 19:25:54 -- nvmf/common.sh@295 -- # net_devs=() 00:19:08.119 19:25:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:08.119 19:25:54 -- nvmf/common.sh@296 -- # e810=() 00:19:08.119 19:25:54 -- nvmf/common.sh@296 -- # local -ga e810 00:19:08.119 19:25:54 -- nvmf/common.sh@297 -- # x722=() 00:19:08.119 19:25:54 -- nvmf/common.sh@297 -- # local -ga x722 00:19:08.119 19:25:54 -- nvmf/common.sh@298 -- # mlx=() 00:19:08.119 19:25:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:08.119 19:25:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:08.119 19:25:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:08.119 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:08.119 19:25:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:08.119 19:25:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:08.119 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:08.119 19:25:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:08.119 19:25:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.119 19:25:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.119 19:25:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:08.119 Found net devices under 0000:18:00.0: mlx_0_0 00:19:08.119 19:25:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.119 19:25:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.119 19:25:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:08.119 Found net devices under 0000:18:00.1: mlx_0_1 00:19:08.119 19:25:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.119 19:25:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:08.119 19:25:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:08.119 19:25:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:08.119 19:25:54 -- nvmf/common.sh@58 -- # uname 00:19:08.119 19:25:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:08.119 19:25:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:08.119 19:25:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:08.119 19:25:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:08.119 19:25:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:08.119 19:25:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:08.119 19:25:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:08.119 19:25:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:08.119 19:25:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:08.119 19:25:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:08.119 19:25:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:08.119 19:25:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:08.119 19:25:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:08.119 19:25:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:08.119 19:25:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:08.119 19:25:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:08.119 19:25:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.119 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:08.119 19:25:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:08.119 19:25:54 -- nvmf/common.sh@105 -- # continue 2 00:19:08.119 19:25:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@105 -- # continue 2 00:19:08.120 19:25:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:08.120 19:25:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.120 19:25:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:08.120 19:25:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:08.120 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:08.120 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:19:08.120 altname enp24s0f0np0 00:19:08.120 altname ens785f0np0 00:19:08.120 inet 192.168.100.8/24 scope global mlx_0_0 00:19:08.120 valid_lft forever preferred_lft forever 00:19:08.120 19:25:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:08.120 19:25:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.120 19:25:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:08.120 19:25:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:08.120 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:08.120 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:19:08.120 altname enp24s0f1np1 00:19:08.120 altname ens785f1np1 00:19:08.120 inet 192.168.100.9/24 scope global mlx_0_1 00:19:08.120 valid_lft forever preferred_lft forever 00:19:08.120 19:25:54 -- nvmf/common.sh@411 -- # return 0 00:19:08.120 19:25:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:08.120 19:25:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:08.120 19:25:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:08.120 19:25:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:08.120 19:25:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:08.120 19:25:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:08.120 19:25:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:08.120 19:25:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:08.120 19:25:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:08.120 19:25:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@105 -- # continue 2 00:19:08.120 19:25:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.120 19:25:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:08.120 19:25:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@105 -- # continue 2 00:19:08.120 19:25:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:08.120 19:25:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.120 19:25:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:08.120 19:25:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.120 19:25:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.120 19:25:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:08.120 192.168.100.9' 00:19:08.120 19:25:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:08.120 192.168.100.9' 00:19:08.120 19:25:54 -- nvmf/common.sh@446 -- # head -n 1 00:19:08.120 19:25:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:08.120 19:25:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:08.120 192.168.100.9' 00:19:08.120 19:25:54 -- nvmf/common.sh@447 -- # tail -n +2 00:19:08.120 19:25:54 -- nvmf/common.sh@447 -- # head -n 1 00:19:08.120 19:25:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:08.120 19:25:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:08.120 19:25:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:08.120 19:25:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:08.120 19:25:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:08.120 19:25:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:08.120 19:25:54 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:19:08.120 19:25:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:08.120 19:25:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:08.120 19:25:54 -- common/autotest_common.sh@10 -- # set +x 00:19:08.120 19:25:54 -- nvmf/common.sh@470 -- # nvmfpid=3066433 00:19:08.120 19:25:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:19:08.120 19:25:54 -- nvmf/common.sh@471 -- # waitforlisten 3066433 00:19:08.120 19:25:54 -- common/autotest_common.sh@817 -- # '[' -z 3066433 ']' 00:19:08.120 19:25:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:08.120 19:25:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:08.120 19:25:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:08.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:08.120 19:25:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:08.120 19:25:54 -- common/autotest_common.sh@10 -- # set +x 00:19:08.120 [2024-04-24 19:25:54.697430] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:08.120 [2024-04-24 19:25:54.697489] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:08.120 EAL: No free 2048 kB hugepages reported on node 1 00:19:08.120 [2024-04-24 19:25:54.769331] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:08.120 [2024-04-24 19:25:54.854708] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:08.120 [2024-04-24 19:25:54.854749] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:08.120 [2024-04-24 19:25:54.854758] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:08.120 [2024-04-24 19:25:54.854782] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:08.120 [2024-04-24 19:25:54.854789] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:08.120 [2024-04-24 19:25:54.854840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:08.120 [2024-04-24 19:25:54.854843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:08.710 19:25:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:08.710 19:25:55 -- common/autotest_common.sh@850 -- # return 0 00:19:08.710 19:25:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:08.710 19:25:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:08.710 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.710 19:25:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:08.710 19:25:55 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:19:08.710 19:25:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.710 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.710 [2024-04-24 19:25:55.560405] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22acc60/0x22b1150) succeed. 00:19:08.710 [2024-04-24 19:25:55.570081] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22ae160/0x22f27e0) succeed. 00:19:08.710 19:25:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.710 19:25:55 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:19:08.710 19:25:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.710 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.710 Malloc0 00:19:08.970 19:25:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.970 19:25:55 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:19:08.970 19:25:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.970 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.970 19:25:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.970 19:25:55 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:19:08.970 19:25:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.970 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.970 19:25:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.970 19:25:55 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:08.970 19:25:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.970 19:25:55 -- common/autotest_common.sh@10 -- # set +x 00:19:08.970 [2024-04-24 19:25:55.728393] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:08.970 19:25:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.970 19:25:55 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:19:08.970 19:25:55 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:19:08.970 19:25:55 -- nvmf/common.sh@521 -- # config=() 00:19:08.970 19:25:55 -- nvmf/common.sh@521 -- # local subsystem config 00:19:08.970 19:25:55 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:08.970 19:25:55 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:08.970 { 00:19:08.970 "params": { 00:19:08.970 "name": "Nvme$subsystem", 00:19:08.970 "trtype": "$TEST_TRANSPORT", 00:19:08.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:08.970 "adrfam": "ipv4", 00:19:08.970 "trsvcid": "$NVMF_PORT", 00:19:08.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:08.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:08.970 "hdgst": ${hdgst:-false}, 00:19:08.970 "ddgst": ${ddgst:-false} 00:19:08.970 }, 00:19:08.970 "method": "bdev_nvme_attach_controller" 00:19:08.970 } 00:19:08.970 EOF 00:19:08.970 )") 00:19:08.970 19:25:55 -- nvmf/common.sh@543 -- # cat 00:19:08.970 19:25:55 -- nvmf/common.sh@545 -- # jq . 00:19:08.970 19:25:55 -- nvmf/common.sh@546 -- # IFS=, 00:19:08.970 19:25:55 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:08.970 "params": { 00:19:08.970 "name": "Nvme0", 00:19:08.970 "trtype": "rdma", 00:19:08.970 "traddr": "192.168.100.8", 00:19:08.970 "adrfam": "ipv4", 00:19:08.970 "trsvcid": "4420", 00:19:08.970 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:08.970 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:19:08.970 "hdgst": false, 00:19:08.970 "ddgst": false 00:19:08.970 }, 00:19:08.970 "method": "bdev_nvme_attach_controller" 00:19:08.970 }' 00:19:08.970 [2024-04-24 19:25:55.776701] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:08.970 [2024-04-24 19:25:55.776764] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3066631 ] 00:19:08.970 EAL: No free 2048 kB hugepages reported on node 1 00:19:08.970 [2024-04-24 19:25:55.844526] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:08.970 [2024-04-24 19:25:55.928590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:08.970 [2024-04-24 19:25:55.928592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:15.543 bdev Nvme0n1 reports 1 memory domains 00:19:15.543 bdev Nvme0n1 supports RDMA memory domain 00:19:15.543 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:15.543 ========================================================================== 00:19:15.543 Latency [us] 00:19:15.543 IOPS MiB/s Average min max 00:19:15.543 Core 2: 21705.92 84.79 736.38 238.34 9021.37 00:19:15.543 Core 3: 21974.26 85.84 727.39 240.79 9214.19 00:19:15.543 ========================================================================== 00:19:15.543 Total : 43680.17 170.63 731.85 238.34 9214.19 00:19:15.543 00:19:15.543 Total operations: 218448, translate 218448 pull_push 0 memzero 0 00:19:15.543 19:26:01 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:19:15.543 19:26:01 -- host/dma.sh@107 -- # gen_malloc_json 00:19:15.543 19:26:01 -- host/dma.sh@21 -- # jq . 00:19:15.543 [2024-04-24 19:26:01.404352] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:15.543 [2024-04-24 19:26:01.404416] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3067359 ] 00:19:15.543 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.543 [2024-04-24 19:26:01.470964] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:15.543 [2024-04-24 19:26:01.550313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:15.543 [2024-04-24 19:26:01.550316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:20.815 bdev Malloc0 reports 2 memory domains 00:19:20.815 bdev Malloc0 doesn't support RDMA memory domain 00:19:20.815 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:20.815 ========================================================================== 00:19:20.815 Latency [us] 00:19:20.815 IOPS MiB/s Average min max 00:19:20.815 Core 2: 14527.77 56.75 1100.51 429.61 1422.38 00:19:20.815 Core 3: 14636.13 57.17 1092.38 381.07 2061.91 00:19:20.815 ========================================================================== 00:19:20.815 Total : 29163.90 113.92 1096.43 381.07 2061.91 00:19:20.815 00:19:20.815 Total operations: 145878, translate 0 pull_push 583512 memzero 0 00:19:20.815 19:26:06 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:19:20.815 19:26:06 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:19:20.815 19:26:06 -- host/dma.sh@48 -- # local subsystem=0 00:19:20.815 19:26:06 -- host/dma.sh@50 -- # jq . 00:19:20.815 Ignoring -M option 00:19:20.815 [2024-04-24 19:26:06.964284] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:20.815 [2024-04-24 19:26:06.964338] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3068085 ] 00:19:20.815 EAL: No free 2048 kB hugepages reported on node 1 00:19:20.815 [2024-04-24 19:26:07.033273] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:20.815 [2024-04-24 19:26:07.117529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:20.815 [2024-04-24 19:26:07.117531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:20.815 [2024-04-24 19:26:07.346887] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:19:26.088 [2024-04-24 19:26:12.374936] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:19:26.088 bdev 41675153-baa8-4345-abd0-ae707557beb6 reports 1 memory domains 00:19:26.088 bdev 41675153-baa8-4345-abd0-ae707557beb6 supports RDMA memory domain 00:19:26.088 Initialization complete, running randread IO for 5 sec on 2 cores 00:19:26.088 ========================================================================== 00:19:26.088 Latency [us] 00:19:26.088 IOPS MiB/s Average min max 00:19:26.088 Core 2: 80587.58 314.80 197.83 78.98 3036.06 00:19:26.088 Core 3: 81787.04 319.48 194.91 76.39 2932.83 00:19:26.088 ========================================================================== 00:19:26.088 Total : 162374.62 634.28 196.36 76.39 3036.06 00:19:26.088 00:19:26.088 Total operations: 811966, translate 0 pull_push 0 memzero 811966 00:19:26.088 19:26:12 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:19:26.088 EAL: No free 2048 kB hugepages reported on node 1 00:19:26.088 [2024-04-24 19:26:12.741332] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:19:28.621 Initializing NVMe Controllers 00:19:28.621 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:19:28.621 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:19:28.621 Initialization complete. Launching workers. 00:19:28.621 ======================================================== 00:19:28.621 Latency(us) 00:19:28.621 Device Information : IOPS MiB/s Average min max 00:19:28.621 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7972.19 5968.29 9975.42 00:19:28.621 ======================================================== 00:19:28.621 Total : 2016.00 7.88 7972.19 5968.29 9975.42 00:19:28.621 00:19:28.621 19:26:15 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:19:28.621 19:26:15 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:19:28.621 19:26:15 -- host/dma.sh@48 -- # local subsystem=0 00:19:28.621 19:26:15 -- host/dma.sh@50 -- # jq . 00:19:28.621 [2024-04-24 19:26:15.087716] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:28.621 [2024-04-24 19:26:15.087776] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3069173 ] 00:19:28.621 EAL: No free 2048 kB hugepages reported on node 1 00:19:28.621 [2024-04-24 19:26:15.154884] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:28.621 [2024-04-24 19:26:15.235460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:28.621 [2024-04-24 19:26:15.235463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:28.621 [2024-04-24 19:26:15.469101] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:19:33.897 [2024-04-24 19:26:20.498420] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:19:33.897 bdev b26f0eae-8ec3-42c7-a68c-5c6cc8c1f595 reports 1 memory domains 00:19:33.897 bdev b26f0eae-8ec3-42c7-a68c-5c6cc8c1f595 supports RDMA memory domain 00:19:33.897 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:33.897 ========================================================================== 00:19:33.897 Latency [us] 00:19:33.897 IOPS MiB/s Average min max 00:19:33.897 Core 2: 19089.58 74.57 837.40 20.25 11376.75 00:19:33.897 Core 3: 19415.14 75.84 823.39 22.18 11516.29 00:19:33.897 ========================================================================== 00:19:33.897 Total : 38504.72 150.41 830.33 20.25 11516.29 00:19:33.897 00:19:33.897 Total operations: 192550, translate 192441 pull_push 0 memzero 109 00:19:33.897 19:26:20 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:19:33.897 19:26:20 -- host/dma.sh@120 -- # nvmftestfini 00:19:33.897 19:26:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:33.897 19:26:20 -- nvmf/common.sh@117 -- # sync 00:19:33.897 19:26:20 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:33.897 19:26:20 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:33.897 19:26:20 -- nvmf/common.sh@120 -- # set +e 00:19:33.897 19:26:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:33.897 19:26:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:33.897 rmmod nvme_rdma 00:19:33.897 rmmod nvme_fabrics 00:19:33.897 19:26:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:33.897 19:26:20 -- nvmf/common.sh@124 -- # set -e 00:19:33.897 19:26:20 -- nvmf/common.sh@125 -- # return 0 00:19:33.897 19:26:20 -- nvmf/common.sh@478 -- # '[' -n 3066433 ']' 00:19:33.897 19:26:20 -- nvmf/common.sh@479 -- # killprocess 3066433 00:19:33.897 19:26:20 -- common/autotest_common.sh@936 -- # '[' -z 3066433 ']' 00:19:33.897 19:26:20 -- common/autotest_common.sh@940 -- # kill -0 3066433 00:19:33.897 19:26:20 -- common/autotest_common.sh@941 -- # uname 00:19:33.897 19:26:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:33.897 19:26:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3066433 00:19:33.897 19:26:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:33.897 19:26:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:33.897 19:26:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3066433' 00:19:33.897 killing process with pid 3066433 00:19:33.897 19:26:20 -- common/autotest_common.sh@955 -- # kill 3066433 00:19:33.897 19:26:20 -- common/autotest_common.sh@960 -- # wait 3066433 00:19:34.156 [2024-04-24 19:26:20.925724] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:34.416 19:26:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:34.416 19:26:21 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:34.416 00:19:34.416 real 0m33.019s 00:19:34.416 user 1m37.550s 00:19:34.416 sys 0m6.139s 00:19:34.416 19:26:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:34.416 19:26:21 -- common/autotest_common.sh@10 -- # set +x 00:19:34.416 ************************************ 00:19:34.416 END TEST dma 00:19:34.416 ************************************ 00:19:34.416 19:26:21 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:19:34.416 19:26:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:34.416 19:26:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:34.416 19:26:21 -- common/autotest_common.sh@10 -- # set +x 00:19:34.416 ************************************ 00:19:34.416 START TEST nvmf_identify 00:19:34.416 ************************************ 00:19:34.416 19:26:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:19:34.677 * Looking for test storage... 00:19:34.677 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:34.677 19:26:21 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:34.677 19:26:21 -- nvmf/common.sh@7 -- # uname -s 00:19:34.677 19:26:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:34.677 19:26:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:34.677 19:26:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:34.677 19:26:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:34.677 19:26:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:34.677 19:26:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:34.677 19:26:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:34.677 19:26:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:34.677 19:26:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:34.677 19:26:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:34.677 19:26:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:19:34.677 19:26:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:19:34.677 19:26:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:34.677 19:26:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:34.677 19:26:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:34.677 19:26:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:34.677 19:26:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:34.677 19:26:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:34.677 19:26:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:34.677 19:26:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:34.677 19:26:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.677 19:26:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.677 19:26:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.677 19:26:21 -- paths/export.sh@5 -- # export PATH 00:19:34.677 19:26:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.677 19:26:21 -- nvmf/common.sh@47 -- # : 0 00:19:34.677 19:26:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:34.677 19:26:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:34.677 19:26:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:34.677 19:26:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:34.677 19:26:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:34.677 19:26:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:34.677 19:26:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:34.677 19:26:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:34.677 19:26:21 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:34.677 19:26:21 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:34.677 19:26:21 -- host/identify.sh@14 -- # nvmftestinit 00:19:34.677 19:26:21 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:34.677 19:26:21 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:34.677 19:26:21 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:34.677 19:26:21 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:34.677 19:26:21 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:34.677 19:26:21 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:34.677 19:26:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:34.677 19:26:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:34.677 19:26:21 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:34.677 19:26:21 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:34.677 19:26:21 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:34.677 19:26:21 -- common/autotest_common.sh@10 -- # set +x 00:19:41.244 19:26:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:41.244 19:26:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:41.244 19:26:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:41.244 19:26:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:41.244 19:26:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:41.244 19:26:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:41.244 19:26:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:41.244 19:26:27 -- nvmf/common.sh@295 -- # net_devs=() 00:19:41.244 19:26:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:41.244 19:26:27 -- nvmf/common.sh@296 -- # e810=() 00:19:41.244 19:26:27 -- nvmf/common.sh@296 -- # local -ga e810 00:19:41.244 19:26:27 -- nvmf/common.sh@297 -- # x722=() 00:19:41.244 19:26:27 -- nvmf/common.sh@297 -- # local -ga x722 00:19:41.244 19:26:27 -- nvmf/common.sh@298 -- # mlx=() 00:19:41.244 19:26:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:41.244 19:26:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.244 19:26:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:41.244 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:41.244 19:26:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:41.244 19:26:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:41.244 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:41.244 19:26:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:41.244 19:26:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.244 19:26:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.244 19:26:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:41.244 Found net devices under 0000:18:00.0: mlx_0_0 00:19:41.244 19:26:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.244 19:26:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.244 19:26:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:41.244 Found net devices under 0000:18:00.1: mlx_0_1 00:19:41.244 19:26:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.244 19:26:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:41.244 19:26:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:41.244 19:26:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:41.244 19:26:27 -- nvmf/common.sh@58 -- # uname 00:19:41.244 19:26:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:41.244 19:26:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:41.244 19:26:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:41.244 19:26:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:41.244 19:26:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:41.244 19:26:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:41.244 19:26:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:41.244 19:26:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:41.244 19:26:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:41.244 19:26:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:41.244 19:26:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:41.244 19:26:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:41.244 19:26:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:41.244 19:26:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:41.244 19:26:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:41.244 19:26:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:41.244 19:26:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:41.244 19:26:27 -- nvmf/common.sh@105 -- # continue 2 00:19:41.244 19:26:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:41.244 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.244 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@105 -- # continue 2 00:19:41.245 19:26:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:41.245 19:26:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:41.245 19:26:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:41.245 19:26:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:41.245 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:41.245 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:19:41.245 altname enp24s0f0np0 00:19:41.245 altname ens785f0np0 00:19:41.245 inet 192.168.100.8/24 scope global mlx_0_0 00:19:41.245 valid_lft forever preferred_lft forever 00:19:41.245 19:26:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:41.245 19:26:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:41.245 19:26:27 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:41.245 19:26:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:41.245 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:41.245 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:19:41.245 altname enp24s0f1np1 00:19:41.245 altname ens785f1np1 00:19:41.245 inet 192.168.100.9/24 scope global mlx_0_1 00:19:41.245 valid_lft forever preferred_lft forever 00:19:41.245 19:26:27 -- nvmf/common.sh@411 -- # return 0 00:19:41.245 19:26:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:41.245 19:26:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:41.245 19:26:27 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:41.245 19:26:27 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:41.245 19:26:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:41.245 19:26:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:41.245 19:26:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:41.245 19:26:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:41.245 19:26:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:41.245 19:26:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:41.245 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.245 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@105 -- # continue 2 00:19:41.245 19:26:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:41.245 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.245 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:41.245 19:26:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:41.245 19:26:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@105 -- # continue 2 00:19:41.245 19:26:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:41.245 19:26:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:41.245 19:26:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:41.245 19:26:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:41.245 19:26:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:41.245 19:26:27 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:41.245 192.168.100.9' 00:19:41.245 19:26:27 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:41.245 192.168.100.9' 00:19:41.245 19:26:27 -- nvmf/common.sh@446 -- # head -n 1 00:19:41.245 19:26:27 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:41.245 19:26:27 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:41.245 192.168.100.9' 00:19:41.245 19:26:27 -- nvmf/common.sh@447 -- # tail -n +2 00:19:41.245 19:26:27 -- nvmf/common.sh@447 -- # head -n 1 00:19:41.245 19:26:27 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:41.245 19:26:27 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:41.245 19:26:27 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:41.245 19:26:27 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:41.245 19:26:27 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:41.245 19:26:27 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:41.245 19:26:27 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:19:41.245 19:26:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:41.245 19:26:27 -- common/autotest_common.sh@10 -- # set +x 00:19:41.245 19:26:27 -- host/identify.sh@19 -- # nvmfpid=3072795 00:19:41.245 19:26:27 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:41.245 19:26:27 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:41.245 19:26:27 -- host/identify.sh@23 -- # waitforlisten 3072795 00:19:41.245 19:26:27 -- common/autotest_common.sh@817 -- # '[' -z 3072795 ']' 00:19:41.245 19:26:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.245 19:26:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:41.245 19:26:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.245 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:41.245 19:26:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:41.245 19:26:27 -- common/autotest_common.sh@10 -- # set +x 00:19:41.245 [2024-04-24 19:26:27.492960] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:41.245 [2024-04-24 19:26:27.493014] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:41.245 EAL: No free 2048 kB hugepages reported on node 1 00:19:41.245 [2024-04-24 19:26:27.566559] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:41.245 [2024-04-24 19:26:27.657948] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:41.245 [2024-04-24 19:26:27.657988] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:41.245 [2024-04-24 19:26:27.657998] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:41.245 [2024-04-24 19:26:27.658006] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:41.245 [2024-04-24 19:26:27.658013] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:41.245 [2024-04-24 19:26:27.658070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:41.245 [2024-04-24 19:26:27.658131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:41.245 [2024-04-24 19:26:27.658212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:41.245 [2024-04-24 19:26:27.658213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:41.505 19:26:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:41.505 19:26:28 -- common/autotest_common.sh@850 -- # return 0 00:19:41.505 19:26:28 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:41.505 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.505 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.505 [2024-04-24 19:26:28.344951] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x17b2240/0x17b6730) succeed. 00:19:41.505 [2024-04-24 19:26:28.355536] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x17b3880/0x17f7dc0) succeed. 00:19:41.505 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.505 19:26:28 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:19:41.505 19:26:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:41.505 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.505 19:26:28 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:41.505 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.505 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.768 Malloc0 00:19:41.768 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.768 19:26:28 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:41.768 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.768 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.768 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.768 19:26:28 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:19:41.768 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.769 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.769 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.769 19:26:28 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:41.769 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.769 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.769 [2024-04-24 19:26:28.572568] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:41.769 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.769 19:26:28 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:19:41.769 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.769 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.769 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.769 19:26:28 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:19:41.769 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:41.769 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:41.769 [2024-04-24 19:26:28.588282] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:19:41.769 [ 00:19:41.769 { 00:19:41.769 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:19:41.769 "subtype": "Discovery", 00:19:41.769 "listen_addresses": [ 00:19:41.769 { 00:19:41.769 "transport": "RDMA", 00:19:41.769 "trtype": "RDMA", 00:19:41.769 "adrfam": "IPv4", 00:19:41.769 "traddr": "192.168.100.8", 00:19:41.769 "trsvcid": "4420" 00:19:41.769 } 00:19:41.769 ], 00:19:41.769 "allow_any_host": true, 00:19:41.769 "hosts": [] 00:19:41.769 }, 00:19:41.769 { 00:19:41.769 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:41.769 "subtype": "NVMe", 00:19:41.769 "listen_addresses": [ 00:19:41.769 { 00:19:41.769 "transport": "RDMA", 00:19:41.769 "trtype": "RDMA", 00:19:41.769 "adrfam": "IPv4", 00:19:41.769 "traddr": "192.168.100.8", 00:19:41.769 "trsvcid": "4420" 00:19:41.769 } 00:19:41.769 ], 00:19:41.769 "allow_any_host": true, 00:19:41.769 "hosts": [], 00:19:41.769 "serial_number": "SPDK00000000000001", 00:19:41.769 "model_number": "SPDK bdev Controller", 00:19:41.769 "max_namespaces": 32, 00:19:41.769 "min_cntlid": 1, 00:19:41.769 "max_cntlid": 65519, 00:19:41.769 "namespaces": [ 00:19:41.769 { 00:19:41.769 "nsid": 1, 00:19:41.769 "bdev_name": "Malloc0", 00:19:41.769 "name": "Malloc0", 00:19:41.769 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:19:41.769 "eui64": "ABCDEF0123456789", 00:19:41.769 "uuid": "63dbf538-062f-47cb-ba65-420a31321533" 00:19:41.769 } 00:19:41.769 ] 00:19:41.769 } 00:19:41.769 ] 00:19:41.769 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:41.769 19:26:28 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:19:41.769 [2024-04-24 19:26:28.631475] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:41.769 [2024-04-24 19:26:28.631513] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3072928 ] 00:19:41.769 EAL: No free 2048 kB hugepages reported on node 1 00:19:41.769 [2024-04-24 19:26:28.678805] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:19:41.769 [2024-04-24 19:26:28.678889] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:19:41.769 [2024-04-24 19:26:28.678909] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:19:41.769 [2024-04-24 19:26:28.678915] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:19:41.769 [2024-04-24 19:26:28.678948] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:19:41.769 [2024-04-24 19:26:28.690092] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:19:41.769 [2024-04-24 19:26:28.704381] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:41.769 [2024-04-24 19:26:28.704392] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:19:41.769 [2024-04-24 19:26:28.704400] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704407] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704414] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704421] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704427] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704434] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704440] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704447] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704453] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704460] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704466] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704473] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704479] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704486] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704492] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704499] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704505] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704511] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704518] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704524] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704531] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704537] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704544] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704555] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704561] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704568] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704574] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704581] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704587] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704596] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704603] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704611] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:19:41.769 [2024-04-24 19:26:28.704619] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:41.769 [2024-04-24 19:26:28.704624] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:19:41.769 [2024-04-24 19:26:28.704647] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.704663] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183d00 00:19:41.769 [2024-04-24 19:26:28.707112] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.769 [2024-04-24 19:26:28.707122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:41.769 [2024-04-24 19:26:28.707132] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.707140] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:19:41.769 [2024-04-24 19:26:28.707147] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:19:41.769 [2024-04-24 19:26:28.707154] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:19:41.769 [2024-04-24 19:26:28.707170] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.707178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.769 [2024-04-24 19:26:28.707202] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.769 [2024-04-24 19:26:28.707208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:19:41.769 [2024-04-24 19:26:28.707218] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:19:41.769 [2024-04-24 19:26:28.707224] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.707231] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:19:41.769 [2024-04-24 19:26:28.707239] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.769 [2024-04-24 19:26:28.707247] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.769 [2024-04-24 19:26:28.707262] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.769 [2024-04-24 19:26:28.707268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:19:41.769 [2024-04-24 19:26:28.707276] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:19:41.770 [2024-04-24 19:26:28.707282] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707289] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707297] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707325] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707338] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707344] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707353] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707361] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707380] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707393] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:19:41.770 [2024-04-24 19:26:28.707400] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707406] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707413] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707520] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:19:41.770 [2024-04-24 19:26:28.707527] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707536] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707567] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707579] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:19:41.770 [2024-04-24 19:26:28.707585] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707594] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707602] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707617] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707629] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:19:41.770 [2024-04-24 19:26:28.707636] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707642] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707649] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:19:41.770 [2024-04-24 19:26:28.707660] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707670] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183d00 00:19:41.770 [2024-04-24 19:26:28.707714] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707730] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:19:41.770 [2024-04-24 19:26:28.707736] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:19:41.770 [2024-04-24 19:26:28.707742] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:19:41.770 [2024-04-24 19:26:28.707751] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:19:41.770 [2024-04-24 19:26:28.707758] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:19:41.770 [2024-04-24 19:26:28.707764] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707770] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707778] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707786] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707795] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707814] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707830] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:41.770 [2024-04-24 19:26:28.707845] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:41.770 [2024-04-24 19:26:28.707859] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:41.770 [2024-04-24 19:26:28.707874] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707881] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:41.770 [2024-04-24 19:26:28.707887] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707895] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707906] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:19:41.770 [2024-04-24 19:26:28.707914] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707922] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.770 [2024-04-24 19:26:28.707939] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.707945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.707953] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:19:41.770 [2024-04-24 19:26:28.707959] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:19:41.770 [2024-04-24 19:26:28.707966] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707975] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.707983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183d00 00:19:41.770 [2024-04-24 19:26:28.708010] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.708016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.708024] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.708035] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:19:41.770 [2024-04-24 19:26:28.708055] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.708063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x183d00 00:19:41.770 [2024-04-24 19:26:28.708071] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.708079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:19:41.770 [2024-04-24 19:26:28.708090] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.708096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:19:41.770 [2024-04-24 19:26:28.708108] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.708116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x183d00 00:19:41.770 [2024-04-24 19:26:28.708123] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:41.770 [2024-04-24 19:26:28.708129] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.770 [2024-04-24 19:26:28.708135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:19:41.771 [2024-04-24 19:26:28.708141] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:41.771 [2024-04-24 19:26:28.708148] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.771 [2024-04-24 19:26:28.708155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:19:41.771 [2024-04-24 19:26:28.708166] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:41.771 [2024-04-24 19:26:28.708173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x183d00 00:19:41.771 [2024-04-24 19:26:28.708180] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:41.771 [2024-04-24 19:26:28.708196] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.771 [2024-04-24 19:26:28.708202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:19:41.771 [2024-04-24 19:26:28.708214] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:41.771 ===================================================== 00:19:41.771 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:19:41.771 ===================================================== 00:19:41.771 Controller Capabilities/Features 00:19:41.771 ================================ 00:19:41.771 Vendor ID: 0000 00:19:41.771 Subsystem Vendor ID: 0000 00:19:41.771 Serial Number: .................... 00:19:41.771 Model Number: ........................................ 00:19:41.771 Firmware Version: 24.05 00:19:41.771 Recommended Arb Burst: 0 00:19:41.771 IEEE OUI Identifier: 00 00 00 00:19:41.771 Multi-path I/O 00:19:41.771 May have multiple subsystem ports: No 00:19:41.771 May have multiple controllers: No 00:19:41.771 Associated with SR-IOV VF: No 00:19:41.771 Max Data Transfer Size: 131072 00:19:41.771 Max Number of Namespaces: 0 00:19:41.771 Max Number of I/O Queues: 1024 00:19:41.771 NVMe Specification Version (VS): 1.3 00:19:41.771 NVMe Specification Version (Identify): 1.3 00:19:41.771 Maximum Queue Entries: 128 00:19:41.771 Contiguous Queues Required: Yes 00:19:41.771 Arbitration Mechanisms Supported 00:19:41.771 Weighted Round Robin: Not Supported 00:19:41.771 Vendor Specific: Not Supported 00:19:41.771 Reset Timeout: 15000 ms 00:19:41.771 Doorbell Stride: 4 bytes 00:19:41.771 NVM Subsystem Reset: Not Supported 00:19:41.771 Command Sets Supported 00:19:41.771 NVM Command Set: Supported 00:19:41.771 Boot Partition: Not Supported 00:19:41.771 Memory Page Size Minimum: 4096 bytes 00:19:41.771 Memory Page Size Maximum: 4096 bytes 00:19:41.771 Persistent Memory Region: Not Supported 00:19:41.771 Optional Asynchronous Events Supported 00:19:41.771 Namespace Attribute Notices: Not Supported 00:19:41.771 Firmware Activation Notices: Not Supported 00:19:41.771 ANA Change Notices: Not Supported 00:19:41.771 PLE Aggregate Log Change Notices: Not Supported 00:19:41.771 LBA Status Info Alert Notices: Not Supported 00:19:41.771 EGE Aggregate Log Change Notices: Not Supported 00:19:41.771 Normal NVM Subsystem Shutdown event: Not Supported 00:19:41.771 Zone Descriptor Change Notices: Not Supported 00:19:41.771 Discovery Log Change Notices: Supported 00:19:41.771 Controller Attributes 00:19:41.771 128-bit Host Identifier: Not Supported 00:19:41.771 Non-Operational Permissive Mode: Not Supported 00:19:41.771 NVM Sets: Not Supported 00:19:41.771 Read Recovery Levels: Not Supported 00:19:41.771 Endurance Groups: Not Supported 00:19:41.771 Predictable Latency Mode: Not Supported 00:19:41.771 Traffic Based Keep ALive: Not Supported 00:19:41.771 Namespace Granularity: Not Supported 00:19:41.771 SQ Associations: Not Supported 00:19:41.771 UUID List: Not Supported 00:19:41.771 Multi-Domain Subsystem: Not Supported 00:19:41.771 Fixed Capacity Management: Not Supported 00:19:41.771 Variable Capacity Management: Not Supported 00:19:41.771 Delete Endurance Group: Not Supported 00:19:41.771 Delete NVM Set: Not Supported 00:19:41.771 Extended LBA Formats Supported: Not Supported 00:19:41.771 Flexible Data Placement Supported: Not Supported 00:19:41.771 00:19:41.771 Controller Memory Buffer Support 00:19:41.771 ================================ 00:19:41.771 Supported: No 00:19:41.771 00:19:41.771 Persistent Memory Region Support 00:19:41.771 ================================ 00:19:41.771 Supported: No 00:19:41.771 00:19:41.771 Admin Command Set Attributes 00:19:41.771 ============================ 00:19:41.771 Security Send/Receive: Not Supported 00:19:41.771 Format NVM: Not Supported 00:19:41.771 Firmware Activate/Download: Not Supported 00:19:41.771 Namespace Management: Not Supported 00:19:41.771 Device Self-Test: Not Supported 00:19:41.771 Directives: Not Supported 00:19:41.771 NVMe-MI: Not Supported 00:19:41.771 Virtualization Management: Not Supported 00:19:41.771 Doorbell Buffer Config: Not Supported 00:19:41.771 Get LBA Status Capability: Not Supported 00:19:41.771 Command & Feature Lockdown Capability: Not Supported 00:19:41.771 Abort Command Limit: 1 00:19:41.771 Async Event Request Limit: 4 00:19:41.771 Number of Firmware Slots: N/A 00:19:41.771 Firmware Slot 1 Read-Only: N/A 00:19:41.771 Firmware Activation Without Reset: N/A 00:19:41.771 Multiple Update Detection Support: N/A 00:19:41.771 Firmware Update Granularity: No Information Provided 00:19:41.771 Per-Namespace SMART Log: No 00:19:41.771 Asymmetric Namespace Access Log Page: Not Supported 00:19:41.771 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:19:41.771 Command Effects Log Page: Not Supported 00:19:41.771 Get Log Page Extended Data: Supported 00:19:41.771 Telemetry Log Pages: Not Supported 00:19:41.771 Persistent Event Log Pages: Not Supported 00:19:41.771 Supported Log Pages Log Page: May Support 00:19:41.771 Commands Supported & Effects Log Page: Not Supported 00:19:41.771 Feature Identifiers & Effects Log Page:May Support 00:19:41.771 NVMe-MI Commands & Effects Log Page: May Support 00:19:41.771 Data Area 4 for Telemetry Log: Not Supported 00:19:41.771 Error Log Page Entries Supported: 128 00:19:41.771 Keep Alive: Not Supported 00:19:41.771 00:19:41.771 NVM Command Set Attributes 00:19:41.771 ========================== 00:19:41.771 Submission Queue Entry Size 00:19:41.771 Max: 1 00:19:41.771 Min: 1 00:19:41.771 Completion Queue Entry Size 00:19:41.771 Max: 1 00:19:41.771 Min: 1 00:19:41.771 Number of Namespaces: 0 00:19:41.771 Compare Command: Not Supported 00:19:41.771 Write Uncorrectable Command: Not Supported 00:19:41.771 Dataset Management Command: Not Supported 00:19:41.771 Write Zeroes Command: Not Supported 00:19:41.771 Set Features Save Field: Not Supported 00:19:41.771 Reservations: Not Supported 00:19:41.771 Timestamp: Not Supported 00:19:41.771 Copy: Not Supported 00:19:41.771 Volatile Write Cache: Not Present 00:19:41.771 Atomic Write Unit (Normal): 1 00:19:41.771 Atomic Write Unit (PFail): 1 00:19:41.771 Atomic Compare & Write Unit: 1 00:19:41.771 Fused Compare & Write: Supported 00:19:41.771 Scatter-Gather List 00:19:41.771 SGL Command Set: Supported 00:19:41.771 SGL Keyed: Supported 00:19:41.771 SGL Bit Bucket Descriptor: Not Supported 00:19:41.771 SGL Metadata Pointer: Not Supported 00:19:41.771 Oversized SGL: Not Supported 00:19:41.771 SGL Metadata Address: Not Supported 00:19:41.771 SGL Offset: Supported 00:19:41.771 Transport SGL Data Block: Not Supported 00:19:41.771 Replay Protected Memory Block: Not Supported 00:19:41.771 00:19:41.771 Firmware Slot Information 00:19:41.771 ========================= 00:19:41.771 Active slot: 0 00:19:41.771 00:19:41.771 00:19:41.771 Error Log 00:19:41.771 ========= 00:19:41.771 00:19:41.771 Active Namespaces 00:19:41.771 ================= 00:19:41.771 Discovery Log Page 00:19:41.771 ================== 00:19:41.771 Generation Counter: 2 00:19:41.771 Number of Records: 2 00:19:41.771 Record Format: 0 00:19:41.771 00:19:41.771 Discovery Log Entry 0 00:19:41.771 ---------------------- 00:19:41.771 Transport Type: 1 (RDMA) 00:19:41.771 Address Family: 1 (IPv4) 00:19:41.771 Subsystem Type: 3 (Current Discovery Subsystem) 00:19:41.771 Entry Flags: 00:19:41.771 Duplicate Returned Information: 1 00:19:41.771 Explicit Persistent Connection Support for Discovery: 1 00:19:41.771 Transport Requirements: 00:19:41.771 Secure Channel: Not Required 00:19:41.771 Port ID: 0 (0x0000) 00:19:41.771 Controller ID: 65535 (0xffff) 00:19:41.771 Admin Max SQ Size: 128 00:19:41.771 Transport Service Identifier: 4420 00:19:41.771 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:19:41.771 Transport Address: 192.168.100.8 00:19:41.771 Transport Specific Address Subtype - RDMA 00:19:41.771 RDMA QP Service Type: 1 (Reliable Connected) 00:19:41.771 RDMA Provider Type: 1 (No provider specified) 00:19:41.771 RDMA CM Service: 1 (RDMA_CM) 00:19:41.771 Discovery Log Entry 1 00:19:41.771 ---------------------- 00:19:41.772 Transport Type: 1 (RDMA) 00:19:41.772 Address Family: 1 (IPv4) 00:19:41.772 Subsystem Type: 2 (NVM Subsystem) 00:19:41.772 Entry Flags: 00:19:41.772 Duplicate Returned Information: 0 00:19:41.772 Explicit Persistent Connection Support for Discovery: 0 00:19:41.772 Transport Requirements: 00:19:41.772 Secure Channel: Not Required 00:19:41.772 Port ID: 0 (0x0000) 00:19:41.772 Controller ID: 65535 (0xffff) 00:19:41.772 Admin Max SQ Size: [2024-04-24 19:26:28.708290] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:19:41.772 [2024-04-24 19:26:28.708301] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27838 doesn't match qid 00:19:41.772 [2024-04-24 19:26:28.708315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32708 cdw0:5 sqhd:5790 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708322] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27838 doesn't match qid 00:19:41.772 [2024-04-24 19:26:28.708330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32708 cdw0:5 sqhd:5790 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708337] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27838 doesn't match qid 00:19:41.772 [2024-04-24 19:26:28.708344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32708 cdw0:5 sqhd:5790 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708351] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27838 doesn't match qid 00:19:41.772 [2024-04-24 19:26:28.708359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32708 cdw0:5 sqhd:5790 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708368] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708399] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708417] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708425] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708431] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708444] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708456] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:19:41.772 [2024-04-24 19:26:28.708463] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:19:41.772 [2024-04-24 19:26:28.708470] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708478] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708488] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708510] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708523] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708532] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708540] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708564] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708577] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708586] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708594] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708612] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708625] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708633] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708659] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708672] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708681] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708711] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708723] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708732] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708740] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708756] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708769] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708780] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708788] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708806] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708818] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708827] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708835] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708853] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708866] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708874] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708882] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708917] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708926] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.708954] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.708959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.708966] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708975] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.708983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.709003] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.709008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.709015] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.709024] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.709032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.709053] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.709059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:41.772 [2024-04-24 19:26:28.709066] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.709076] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.772 [2024-04-24 19:26:28.709084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.772 [2024-04-24 19:26:28.709100] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.772 [2024-04-24 19:26:28.709106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709112] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709121] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709145] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709157] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709166] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709174] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709188] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709201] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709236] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709248] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709257] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709265] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709304] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709312] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709329] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709343] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709352] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709360] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709376] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709389] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709398] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709425] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709438] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709447] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709471] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709483] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709492] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709518] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709530] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709539] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709547] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709569] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709582] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709591] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709599] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709622] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709636] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709645] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709669] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709681] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709690] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709718] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709730] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709739] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.773 [2024-04-24 19:26:28.709762] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.773 [2024-04-24 19:26:28.709768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:19:41.773 [2024-04-24 19:26:28.709775] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:41.773 [2024-04-24 19:26:28.709784] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709791] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.709811] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.709817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.709823] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709832] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.709861] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.709867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.709874] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709883] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.709906] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.709914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.709921] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709930] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709938] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.709953] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.709959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.709966] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709975] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.709983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.709996] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710009] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710018] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710025] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710043] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710055] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710064] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710072] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710095] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710108] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710117] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710125] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710142] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710155] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710164] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710172] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710187] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710201] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710233] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710246] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710255] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710263] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710294] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710303] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710311] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710327] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710339] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710348] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710356] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710379] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710392] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710401] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710428] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710440] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710449] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710457] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710478] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710491] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710500] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.710508] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.710528] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.710533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.710540] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.716556] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.716566] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:41.774 [2024-04-24 19:26:28.716581] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:41.774 [2024-04-24 19:26:28.716587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:001d p:0 m:0 dnr:0 00:19:41.774 [2024-04-24 19:26:28.716593] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:41.774 [2024-04-24 19:26:28.716601] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 8 milliseconds 00:19:41.774 128 00:19:41.774 Transport Service Identifier: 4420 00:19:41.774 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:19:41.774 Transport Address: 192.168.100.8 00:19:41.774 Transport Specific Address Subtype - RDMA 00:19:41.774 RDMA QP Service Type: 1 (Reliable Connected) 00:19:41.774 RDMA Provider Type: 1 (No provider specified) 00:19:41.774 RDMA CM Service: 1 (RDMA_CM) 00:19:41.775 19:26:28 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:19:42.039 [2024-04-24 19:26:28.790815] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:42.039 [2024-04-24 19:26:28.790856] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3073003 ] 00:19:42.039 EAL: No free 2048 kB hugepages reported on node 1 00:19:42.039 [2024-04-24 19:26:28.838750] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:19:42.039 [2024-04-24 19:26:28.838824] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:19:42.039 [2024-04-24 19:26:28.838840] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:19:42.039 [2024-04-24 19:26:28.838846] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:19:42.039 [2024-04-24 19:26:28.838875] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:19:42.039 [2024-04-24 19:26:28.848956] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:19:42.039 [2024-04-24 19:26:28.859223] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:42.039 [2024-04-24 19:26:28.859233] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:19:42.039 [2024-04-24 19:26:28.859241] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859249] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859255] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859262] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859268] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859275] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859281] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859288] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859294] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859301] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859307] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859314] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859320] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859326] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859333] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859339] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859346] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859352] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859359] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859365] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859372] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859378] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859385] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859391] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859398] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859404] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859410] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859417] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859423] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859430] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859439] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859445] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:19:42.039 [2024-04-24 19:26:28.859454] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:42.039 [2024-04-24 19:26:28.859459] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:19:42.039 [2024-04-24 19:26:28.859480] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.859494] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183d00 00:19:42.039 [2024-04-24 19:26:28.864556] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.864565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.864574] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864581] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:19:42.039 [2024-04-24 19:26:28.864588] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:19:42.039 [2024-04-24 19:26:28.864595] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:19:42.039 [2024-04-24 19:26:28.864612] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864620] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.039 [2024-04-24 19:26:28.864639] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.864645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.864655] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:19:42.039 [2024-04-24 19:26:28.864661] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864668] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:19:42.039 [2024-04-24 19:26:28.864676] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.039 [2024-04-24 19:26:28.864699] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.864704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.864712] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:19:42.039 [2024-04-24 19:26:28.864718] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864725] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.864733] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864741] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.039 [2024-04-24 19:26:28.864764] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.864770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.864779] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.864785] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864794] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864802] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.039 [2024-04-24 19:26:28.864820] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.864826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.864832] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:19:42.039 [2024-04-24 19:26:28.864839] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.864845] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864852] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.864959] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:19:42.039 [2024-04-24 19:26:28.864964] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.864973] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.039 [2024-04-24 19:26:28.864981] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.039 [2024-04-24 19:26:28.864997] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.039 [2024-04-24 19:26:28.865003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:19:42.039 [2024-04-24 19:26:28.865010] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:19:42.039 [2024-04-24 19:26:28.865016] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865024] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.040 [2024-04-24 19:26:28.865046] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865059] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:19:42.040 [2024-04-24 19:26:28.865065] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865071] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865078] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:19:42.040 [2024-04-24 19:26:28.865087] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865098] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183d00 00:19:42.040 [2024-04-24 19:26:28.865146] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865161] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:19:42.040 [2024-04-24 19:26:28.865168] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:19:42.040 [2024-04-24 19:26:28.865174] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:19:42.040 [2024-04-24 19:26:28.865182] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:19:42.040 [2024-04-24 19:26:28.865188] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:19:42.040 [2024-04-24 19:26:28.865194] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865200] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865208] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865216] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865224] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.040 [2024-04-24 19:26:28.865248] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865262] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:42.040 [2024-04-24 19:26:28.865277] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:42.040 [2024-04-24 19:26:28.865292] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:42.040 [2024-04-24 19:26:28.865306] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:42.040 [2024-04-24 19:26:28.865320] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865326] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865336] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865344] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865353] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.040 [2024-04-24 19:26:28.865373] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865386] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:19:42.040 [2024-04-24 19:26:28.865392] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865398] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865406] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865414] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865422] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865430] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.040 [2024-04-24 19:26:28.865452] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865500] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865506] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865514] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865531] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x183d00 00:19:42.040 [2024-04-24 19:26:28.865557] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865575] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:19:42.040 [2024-04-24 19:26:28.865590] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865596] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865604] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865612] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183d00 00:19:42.040 [2024-04-24 19:26:28.865650] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865671] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865677] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865686] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865694] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183d00 00:19:42.040 [2024-04-24 19:26:28.865730] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.040 [2024-04-24 19:26:28.865736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:19:42.040 [2024-04-24 19:26:28.865745] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865751] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865759] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865768] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865775] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865782] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865788] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:19:42.040 [2024-04-24 19:26:28.865794] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:19:42.040 [2024-04-24 19:26:28.865801] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:19:42.040 [2024-04-24 19:26:28.865817] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865825] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.040 [2024-04-24 19:26:28.865832] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:42.040 [2024-04-24 19:26:28.865840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:19:42.041 [2024-04-24 19:26:28.865851] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.865856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.865863] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865870] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.865875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.865882] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865891] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865901] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.041 [2024-04-24 19:26:28.865924] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.865929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.865936] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865945] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865953] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.041 [2024-04-24 19:26:28.865976] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.865981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.865988] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.865997] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866005] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.041 [2024-04-24 19:26:28.866025] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.866030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.866037] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866048] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x183d00 00:19:42.041 [2024-04-24 19:26:28.866065] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866073] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x183d00 00:19:42.041 [2024-04-24 19:26:28.866082] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866089] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x183d00 00:19:42.041 [2024-04-24 19:26:28.866098] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x183d00 00:19:42.041 [2024-04-24 19:26:28.866115] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.866121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.866135] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866142] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.866148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.866159] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866165] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.866171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.866179] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:42.041 [2024-04-24 19:26:28.866185] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.041 [2024-04-24 19:26:28.866190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:19:42.041 [2024-04-24 19:26:28.866201] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:42.041 ===================================================== 00:19:42.041 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:19:42.041 ===================================================== 00:19:42.041 Controller Capabilities/Features 00:19:42.041 ================================ 00:19:42.041 Vendor ID: 8086 00:19:42.041 Subsystem Vendor ID: 8086 00:19:42.041 Serial Number: SPDK00000000000001 00:19:42.041 Model Number: SPDK bdev Controller 00:19:42.041 Firmware Version: 24.05 00:19:42.041 Recommended Arb Burst: 6 00:19:42.041 IEEE OUI Identifier: e4 d2 5c 00:19:42.041 Multi-path I/O 00:19:42.041 May have multiple subsystem ports: Yes 00:19:42.041 May have multiple controllers: Yes 00:19:42.041 Associated with SR-IOV VF: No 00:19:42.041 Max Data Transfer Size: 131072 00:19:42.041 Max Number of Namespaces: 32 00:19:42.041 Max Number of I/O Queues: 127 00:19:42.041 NVMe Specification Version (VS): 1.3 00:19:42.041 NVMe Specification Version (Identify): 1.3 00:19:42.041 Maximum Queue Entries: 128 00:19:42.041 Contiguous Queues Required: Yes 00:19:42.041 Arbitration Mechanisms Supported 00:19:42.041 Weighted Round Robin: Not Supported 00:19:42.041 Vendor Specific: Not Supported 00:19:42.041 Reset Timeout: 15000 ms 00:19:42.041 Doorbell Stride: 4 bytes 00:19:42.041 NVM Subsystem Reset: Not Supported 00:19:42.041 Command Sets Supported 00:19:42.041 NVM Command Set: Supported 00:19:42.041 Boot Partition: Not Supported 00:19:42.041 Memory Page Size Minimum: 4096 bytes 00:19:42.041 Memory Page Size Maximum: 4096 bytes 00:19:42.041 Persistent Memory Region: Not Supported 00:19:42.041 Optional Asynchronous Events Supported 00:19:42.041 Namespace Attribute Notices: Supported 00:19:42.041 Firmware Activation Notices: Not Supported 00:19:42.041 ANA Change Notices: Not Supported 00:19:42.041 PLE Aggregate Log Change Notices: Not Supported 00:19:42.041 LBA Status Info Alert Notices: Not Supported 00:19:42.041 EGE Aggregate Log Change Notices: Not Supported 00:19:42.041 Normal NVM Subsystem Shutdown event: Not Supported 00:19:42.041 Zone Descriptor Change Notices: Not Supported 00:19:42.041 Discovery Log Change Notices: Not Supported 00:19:42.041 Controller Attributes 00:19:42.041 128-bit Host Identifier: Supported 00:19:42.041 Non-Operational Permissive Mode: Not Supported 00:19:42.041 NVM Sets: Not Supported 00:19:42.041 Read Recovery Levels: Not Supported 00:19:42.041 Endurance Groups: Not Supported 00:19:42.041 Predictable Latency Mode: Not Supported 00:19:42.041 Traffic Based Keep ALive: Not Supported 00:19:42.041 Namespace Granularity: Not Supported 00:19:42.041 SQ Associations: Not Supported 00:19:42.041 UUID List: Not Supported 00:19:42.041 Multi-Domain Subsystem: Not Supported 00:19:42.041 Fixed Capacity Management: Not Supported 00:19:42.041 Variable Capacity Management: Not Supported 00:19:42.041 Delete Endurance Group: Not Supported 00:19:42.041 Delete NVM Set: Not Supported 00:19:42.041 Extended LBA Formats Supported: Not Supported 00:19:42.041 Flexible Data Placement Supported: Not Supported 00:19:42.041 00:19:42.041 Controller Memory Buffer Support 00:19:42.041 ================================ 00:19:42.041 Supported: No 00:19:42.041 00:19:42.041 Persistent Memory Region Support 00:19:42.041 ================================ 00:19:42.041 Supported: No 00:19:42.041 00:19:42.041 Admin Command Set Attributes 00:19:42.041 ============================ 00:19:42.041 Security Send/Receive: Not Supported 00:19:42.041 Format NVM: Not Supported 00:19:42.041 Firmware Activate/Download: Not Supported 00:19:42.041 Namespace Management: Not Supported 00:19:42.041 Device Self-Test: Not Supported 00:19:42.041 Directives: Not Supported 00:19:42.041 NVMe-MI: Not Supported 00:19:42.041 Virtualization Management: Not Supported 00:19:42.041 Doorbell Buffer Config: Not Supported 00:19:42.041 Get LBA Status Capability: Not Supported 00:19:42.041 Command & Feature Lockdown Capability: Not Supported 00:19:42.041 Abort Command Limit: 4 00:19:42.041 Async Event Request Limit: 4 00:19:42.041 Number of Firmware Slots: N/A 00:19:42.041 Firmware Slot 1 Read-Only: N/A 00:19:42.041 Firmware Activation Without Reset: N/A 00:19:42.041 Multiple Update Detection Support: N/A 00:19:42.041 Firmware Update Granularity: No Information Provided 00:19:42.041 Per-Namespace SMART Log: No 00:19:42.041 Asymmetric Namespace Access Log Page: Not Supported 00:19:42.041 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:19:42.041 Command Effects Log Page: Supported 00:19:42.041 Get Log Page Extended Data: Supported 00:19:42.041 Telemetry Log Pages: Not Supported 00:19:42.041 Persistent Event Log Pages: Not Supported 00:19:42.041 Supported Log Pages Log Page: May Support 00:19:42.041 Commands Supported & Effects Log Page: Not Supported 00:19:42.041 Feature Identifiers & Effects Log Page:May Support 00:19:42.042 NVMe-MI Commands & Effects Log Page: May Support 00:19:42.042 Data Area 4 for Telemetry Log: Not Supported 00:19:42.042 Error Log Page Entries Supported: 128 00:19:42.042 Keep Alive: Supported 00:19:42.042 Keep Alive Granularity: 10000 ms 00:19:42.042 00:19:42.042 NVM Command Set Attributes 00:19:42.042 ========================== 00:19:42.042 Submission Queue Entry Size 00:19:42.042 Max: 64 00:19:42.042 Min: 64 00:19:42.042 Completion Queue Entry Size 00:19:42.042 Max: 16 00:19:42.042 Min: 16 00:19:42.042 Number of Namespaces: 32 00:19:42.042 Compare Command: Supported 00:19:42.042 Write Uncorrectable Command: Not Supported 00:19:42.042 Dataset Management Command: Supported 00:19:42.042 Write Zeroes Command: Supported 00:19:42.042 Set Features Save Field: Not Supported 00:19:42.042 Reservations: Supported 00:19:42.042 Timestamp: Not Supported 00:19:42.042 Copy: Supported 00:19:42.042 Volatile Write Cache: Present 00:19:42.042 Atomic Write Unit (Normal): 1 00:19:42.042 Atomic Write Unit (PFail): 1 00:19:42.042 Atomic Compare & Write Unit: 1 00:19:42.042 Fused Compare & Write: Supported 00:19:42.042 Scatter-Gather List 00:19:42.042 SGL Command Set: Supported 00:19:42.042 SGL Keyed: Supported 00:19:42.042 SGL Bit Bucket Descriptor: Not Supported 00:19:42.042 SGL Metadata Pointer: Not Supported 00:19:42.042 Oversized SGL: Not Supported 00:19:42.042 SGL Metadata Address: Not Supported 00:19:42.042 SGL Offset: Supported 00:19:42.042 Transport SGL Data Block: Not Supported 00:19:42.042 Replay Protected Memory Block: Not Supported 00:19:42.042 00:19:42.042 Firmware Slot Information 00:19:42.042 ========================= 00:19:42.042 Active slot: 1 00:19:42.042 Slot 1 Firmware Revision: 24.05 00:19:42.042 00:19:42.042 00:19:42.042 Commands Supported and Effects 00:19:42.042 ============================== 00:19:42.042 Admin Commands 00:19:42.042 -------------- 00:19:42.042 Get Log Page (02h): Supported 00:19:42.042 Identify (06h): Supported 00:19:42.042 Abort (08h): Supported 00:19:42.042 Set Features (09h): Supported 00:19:42.042 Get Features (0Ah): Supported 00:19:42.042 Asynchronous Event Request (0Ch): Supported 00:19:42.042 Keep Alive (18h): Supported 00:19:42.042 I/O Commands 00:19:42.042 ------------ 00:19:42.042 Flush (00h): Supported LBA-Change 00:19:42.042 Write (01h): Supported LBA-Change 00:19:42.042 Read (02h): Supported 00:19:42.042 Compare (05h): Supported 00:19:42.042 Write Zeroes (08h): Supported LBA-Change 00:19:42.042 Dataset Management (09h): Supported LBA-Change 00:19:42.042 Copy (19h): Supported LBA-Change 00:19:42.042 Unknown (79h): Supported LBA-Change 00:19:42.042 Unknown (7Ah): Supported 00:19:42.042 00:19:42.042 Error Log 00:19:42.042 ========= 00:19:42.042 00:19:42.042 Arbitration 00:19:42.042 =========== 00:19:42.042 Arbitration Burst: 1 00:19:42.042 00:19:42.042 Power Management 00:19:42.042 ================ 00:19:42.042 Number of Power States: 1 00:19:42.042 Current Power State: Power State #0 00:19:42.042 Power State #0: 00:19:42.042 Max Power: 0.00 W 00:19:42.042 Non-Operational State: Operational 00:19:42.042 Entry Latency: Not Reported 00:19:42.042 Exit Latency: Not Reported 00:19:42.042 Relative Read Throughput: 0 00:19:42.042 Relative Read Latency: 0 00:19:42.042 Relative Write Throughput: 0 00:19:42.042 Relative Write Latency: 0 00:19:42.042 Idle Power: Not Reported 00:19:42.042 Active Power: Not Reported 00:19:42.042 Non-Operational Permissive Mode: Not Supported 00:19:42.042 00:19:42.042 Health Information 00:19:42.042 ================== 00:19:42.042 Critical Warnings: 00:19:42.042 Available Spare Space: OK 00:19:42.042 Temperature: OK 00:19:42.042 Device Reliability: OK 00:19:42.042 Read Only: No 00:19:42.042 Volatile Memory Backup: OK 00:19:42.042 Current Temperature: 0 Kelvin (-273 Celsius) 00:19:42.042 Temperature Threshold: [2024-04-24 19:26:28.866285] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866294] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866311] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866324] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866349] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:19:42.042 [2024-04-24 19:26:28.866358] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 12017 doesn't match qid 00:19:42.042 [2024-04-24 19:26:28.866373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32612 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866380] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 12017 doesn't match qid 00:19:42.042 [2024-04-24 19:26:28.866388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32612 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866395] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 12017 doesn't match qid 00:19:42.042 [2024-04-24 19:26:28.866403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32612 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866409] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 12017 doesn't match qid 00:19:42.042 [2024-04-24 19:26:28.866417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32612 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866426] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866434] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866451] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866465] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866473] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866479] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866497] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866512] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:19:42.042 [2024-04-24 19:26:28.866518] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:19:42.042 [2024-04-24 19:26:28.866524] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866533] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866541] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866561] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866574] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866583] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866592] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866608] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866620] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866630] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866659] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866672] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866681] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866705] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:42.042 [2024-04-24 19:26:28.866717] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866726] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.042 [2024-04-24 19:26:28.866735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.042 [2024-04-24 19:26:28.866751] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.042 [2024-04-24 19:26:28.866757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.866764] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866773] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866782] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.866799] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.866804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.866811] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866820] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.866844] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.866850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.866857] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866865] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.866892] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.866897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.866904] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866913] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866921] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.866937] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.866943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.866950] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866959] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.866967] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.866988] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.866994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867001] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867010] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867032] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867044] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867053] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867064] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867080] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867092] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867101] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867133] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867145] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867154] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867162] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867184] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867196] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867205] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867213] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867229] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867241] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867250] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867258] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867274] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867287] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867296] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867320] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867332] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867342] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867350] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867366] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867378] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867387] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867395] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.043 [2024-04-24 19:26:28.867415] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.043 [2024-04-24 19:26:28.867421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:19:42.043 [2024-04-24 19:26:28.867427] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867436] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.043 [2024-04-24 19:26:28.867444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867460] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867472] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867481] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867489] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867505] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867518] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867527] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867534] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867556] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867568] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867577] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867603] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867615] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867626] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867634] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867655] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867667] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867676] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867704] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867716] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867725] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867733] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867747] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867760] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867769] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867777] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867792] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867804] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867813] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867821] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867841] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867853] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867862] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867870] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867889] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867903] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867912] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867920] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867935] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867948] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867957] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.867965] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.867982] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.867988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.867995] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868003] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868027] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868039] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868048] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868056] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868076] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868088] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868097] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868126] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868138] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868147] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868171] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868184] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868193] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868219] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868231] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868240] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868248] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.044 [2024-04-24 19:26:28.868264] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.044 [2024-04-24 19:26:28.868269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:42.044 [2024-04-24 19:26:28.868276] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868285] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.044 [2024-04-24 19:26:28.868293] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.868312] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.868318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.868325] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868333] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868341] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.868355] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.868361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.868368] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868376] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868384] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.868402] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.868408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.868414] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868423] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868431] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.868451] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.868458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.868464] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868473] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868481] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.868501] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.868506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.868513] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868522] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.868530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.872554] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.872561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.872568] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.872577] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.872585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:42.045 [2024-04-24 19:26:28.872603] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:42.045 [2024-04-24 19:26:28.872609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0006 p:0 m:0 dnr:0 00:19:42.045 [2024-04-24 19:26:28.872615] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183d00 00:19:42.045 [2024-04-24 19:26:28.872622] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:19:42.045 0 Kelvin (-273 Celsius) 00:19:42.045 Available Spare: 0% 00:19:42.045 Available Spare Threshold: 0% 00:19:42.045 Life Percentage Used: 0% 00:19:42.045 Data Units Read: 0 00:19:42.045 Data Units Written: 0 00:19:42.045 Host Read Commands: 0 00:19:42.045 Host Write Commands: 0 00:19:42.045 Controller Busy Time: 0 minutes 00:19:42.045 Power Cycles: 0 00:19:42.045 Power On Hours: 0 hours 00:19:42.045 Unsafe Shutdowns: 0 00:19:42.045 Unrecoverable Media Errors: 0 00:19:42.045 Lifetime Error Log Entries: 0 00:19:42.045 Warning Temperature Time: 0 minutes 00:19:42.045 Critical Temperature Time: 0 minutes 00:19:42.045 00:19:42.045 Number of Queues 00:19:42.045 ================ 00:19:42.045 Number of I/O Submission Queues: 127 00:19:42.045 Number of I/O Completion Queues: 127 00:19:42.045 00:19:42.045 Active Namespaces 00:19:42.045 ================= 00:19:42.045 Namespace ID:1 00:19:42.045 Error Recovery Timeout: Unlimited 00:19:42.045 Command Set Identifier: NVM (00h) 00:19:42.045 Deallocate: Supported 00:19:42.045 Deallocated/Unwritten Error: Not Supported 00:19:42.045 Deallocated Read Value: Unknown 00:19:42.045 Deallocate in Write Zeroes: Not Supported 00:19:42.045 Deallocated Guard Field: 0xFFFF 00:19:42.045 Flush: Supported 00:19:42.045 Reservation: Supported 00:19:42.045 Namespace Sharing Capabilities: Multiple Controllers 00:19:42.045 Size (in LBAs): 131072 (0GiB) 00:19:42.045 Capacity (in LBAs): 131072 (0GiB) 00:19:42.045 Utilization (in LBAs): 131072 (0GiB) 00:19:42.045 NGUID: ABCDEF0123456789ABCDEF0123456789 00:19:42.045 EUI64: ABCDEF0123456789 00:19:42.045 UUID: 63dbf538-062f-47cb-ba65-420a31321533 00:19:42.045 Thin Provisioning: Not Supported 00:19:42.045 Per-NS Atomic Units: Yes 00:19:42.045 Atomic Boundary Size (Normal): 0 00:19:42.045 Atomic Boundary Size (PFail): 0 00:19:42.045 Atomic Boundary Offset: 0 00:19:42.045 Maximum Single Source Range Length: 65535 00:19:42.045 Maximum Copy Length: 65535 00:19:42.045 Maximum Source Range Count: 1 00:19:42.045 NGUID/EUI64 Never Reused: No 00:19:42.045 Namespace Write Protected: No 00:19:42.045 Number of LBA Formats: 1 00:19:42.045 Current LBA Format: LBA Format #00 00:19:42.045 LBA Format #00: Data Size: 512 Metadata Size: 0 00:19:42.045 00:19:42.045 19:26:28 -- host/identify.sh@51 -- # sync 00:19:42.045 19:26:28 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:42.045 19:26:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:42.045 19:26:28 -- common/autotest_common.sh@10 -- # set +x 00:19:42.045 19:26:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:42.045 19:26:28 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:19:42.045 19:26:28 -- host/identify.sh@56 -- # nvmftestfini 00:19:42.045 19:26:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:42.045 19:26:28 -- nvmf/common.sh@117 -- # sync 00:19:42.045 19:26:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:42.045 19:26:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:42.045 19:26:28 -- nvmf/common.sh@120 -- # set +e 00:19:42.045 19:26:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:42.045 19:26:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:42.045 rmmod nvme_rdma 00:19:42.045 rmmod nvme_fabrics 00:19:42.045 19:26:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:42.045 19:26:28 -- nvmf/common.sh@124 -- # set -e 00:19:42.045 19:26:28 -- nvmf/common.sh@125 -- # return 0 00:19:42.045 19:26:28 -- nvmf/common.sh@478 -- # '[' -n 3072795 ']' 00:19:42.045 19:26:28 -- nvmf/common.sh@479 -- # killprocess 3072795 00:19:42.045 19:26:28 -- common/autotest_common.sh@936 -- # '[' -z 3072795 ']' 00:19:42.045 19:26:28 -- common/autotest_common.sh@940 -- # kill -0 3072795 00:19:42.045 19:26:28 -- common/autotest_common.sh@941 -- # uname 00:19:42.045 19:26:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:42.045 19:26:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3072795 00:19:42.045 19:26:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:42.045 19:26:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:42.045 19:26:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3072795' 00:19:42.045 killing process with pid 3072795 00:19:42.045 19:26:29 -- common/autotest_common.sh@955 -- # kill 3072795 00:19:42.045 [2024-04-24 19:26:29.047215] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:19:42.045 19:26:29 -- common/autotest_common.sh@960 -- # wait 3072795 00:19:42.305 [2024-04-24 19:26:29.135429] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:42.565 19:26:29 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:42.565 19:26:29 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:42.565 00:19:42.565 real 0m7.965s 00:19:42.565 user 0m8.439s 00:19:42.565 sys 0m5.002s 00:19:42.565 19:26:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:42.565 19:26:29 -- common/autotest_common.sh@10 -- # set +x 00:19:42.565 ************************************ 00:19:42.565 END TEST nvmf_identify 00:19:42.565 ************************************ 00:19:42.565 19:26:29 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:19:42.565 19:26:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:42.565 19:26:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:42.565 19:26:29 -- common/autotest_common.sh@10 -- # set +x 00:19:42.825 ************************************ 00:19:42.825 START TEST nvmf_perf 00:19:42.825 ************************************ 00:19:42.825 19:26:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:19:42.825 * Looking for test storage... 00:19:42.825 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:42.825 19:26:29 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:42.825 19:26:29 -- nvmf/common.sh@7 -- # uname -s 00:19:42.825 19:26:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:42.825 19:26:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:42.825 19:26:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:42.825 19:26:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:42.825 19:26:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:42.825 19:26:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:42.825 19:26:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:42.825 19:26:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:42.825 19:26:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:42.825 19:26:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:42.825 19:26:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:19:42.825 19:26:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:19:42.825 19:26:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:42.825 19:26:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:42.825 19:26:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:42.825 19:26:29 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:42.825 19:26:29 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:42.825 19:26:29 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:42.825 19:26:29 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:42.825 19:26:29 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:42.825 19:26:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.825 19:26:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.825 19:26:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.825 19:26:29 -- paths/export.sh@5 -- # export PATH 00:19:42.825 19:26:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.825 19:26:29 -- nvmf/common.sh@47 -- # : 0 00:19:42.825 19:26:29 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:42.825 19:26:29 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:42.825 19:26:29 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:42.825 19:26:29 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:42.825 19:26:29 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:42.825 19:26:29 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:42.825 19:26:29 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:42.825 19:26:29 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:42.825 19:26:29 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:19:42.825 19:26:29 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:19:42.825 19:26:29 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:19:42.825 19:26:29 -- host/perf.sh@17 -- # nvmftestinit 00:19:42.825 19:26:29 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:42.825 19:26:29 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:42.826 19:26:29 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:42.826 19:26:29 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:42.826 19:26:29 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:42.826 19:26:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:42.826 19:26:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:42.826 19:26:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:42.826 19:26:29 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:42.826 19:26:29 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:42.826 19:26:29 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:42.826 19:26:29 -- common/autotest_common.sh@10 -- # set +x 00:19:49.478 19:26:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:49.478 19:26:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:49.478 19:26:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:49.478 19:26:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:49.478 19:26:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:49.478 19:26:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:49.478 19:26:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:49.478 19:26:35 -- nvmf/common.sh@295 -- # net_devs=() 00:19:49.478 19:26:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:49.478 19:26:35 -- nvmf/common.sh@296 -- # e810=() 00:19:49.478 19:26:35 -- nvmf/common.sh@296 -- # local -ga e810 00:19:49.478 19:26:35 -- nvmf/common.sh@297 -- # x722=() 00:19:49.478 19:26:35 -- nvmf/common.sh@297 -- # local -ga x722 00:19:49.478 19:26:35 -- nvmf/common.sh@298 -- # mlx=() 00:19:49.478 19:26:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:49.478 19:26:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:49.478 19:26:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:49.478 19:26:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:49.478 19:26:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:49.478 19:26:35 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:49.478 19:26:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:49.478 19:26:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:49.478 19:26:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:49.478 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:49.478 19:26:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:49.478 19:26:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:49.478 19:26:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:49.478 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:49.478 19:26:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:49.478 19:26:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:49.478 19:26:35 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:49.478 19:26:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:49.478 19:26:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:49.478 19:26:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:49.478 19:26:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:49.478 19:26:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:49.478 Found net devices under 0000:18:00.0: mlx_0_0 00:19:49.478 19:26:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:49.478 19:26:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:49.478 19:26:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:49.478 19:26:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:49.478 19:26:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:49.478 19:26:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:49.478 Found net devices under 0000:18:00.1: mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:49.479 19:26:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:49.479 19:26:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:49.479 19:26:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:49.479 19:26:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:49.479 19:26:35 -- nvmf/common.sh@58 -- # uname 00:19:49.479 19:26:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:49.479 19:26:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:49.479 19:26:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:49.479 19:26:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:49.479 19:26:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:49.479 19:26:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:49.479 19:26:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:49.479 19:26:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:49.479 19:26:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:49.479 19:26:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:49.479 19:26:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:49.479 19:26:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:49.479 19:26:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:49.479 19:26:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:49.479 19:26:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:49.479 19:26:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:49.479 19:26:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@105 -- # continue 2 00:19:49.479 19:26:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@105 -- # continue 2 00:19:49.479 19:26:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:49.479 19:26:35 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:49.479 19:26:35 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:49.479 19:26:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:49.479 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:49.479 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:19:49.479 altname enp24s0f0np0 00:19:49.479 altname ens785f0np0 00:19:49.479 inet 192.168.100.8/24 scope global mlx_0_0 00:19:49.479 valid_lft forever preferred_lft forever 00:19:49.479 19:26:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:49.479 19:26:35 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:49.479 19:26:35 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:49.479 19:26:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:49.479 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:49.479 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:19:49.479 altname enp24s0f1np1 00:19:49.479 altname ens785f1np1 00:19:49.479 inet 192.168.100.9/24 scope global mlx_0_1 00:19:49.479 valid_lft forever preferred_lft forever 00:19:49.479 19:26:35 -- nvmf/common.sh@411 -- # return 0 00:19:49.479 19:26:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:49.479 19:26:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:49.479 19:26:35 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:49.479 19:26:35 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:49.479 19:26:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:49.479 19:26:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:49.479 19:26:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:49.479 19:26:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:49.479 19:26:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:49.479 19:26:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@105 -- # continue 2 00:19:49.479 19:26:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:49.479 19:26:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:49.479 19:26:35 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@105 -- # continue 2 00:19:49.479 19:26:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:49.479 19:26:35 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:49.479 19:26:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:49.479 19:26:35 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:49.479 19:26:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:49.479 19:26:35 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:49.479 192.168.100.9' 00:19:49.479 19:26:35 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:49.479 192.168.100.9' 00:19:49.479 19:26:35 -- nvmf/common.sh@446 -- # head -n 1 00:19:49.479 19:26:35 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:49.479 19:26:35 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:49.479 192.168.100.9' 00:19:49.479 19:26:35 -- nvmf/common.sh@447 -- # tail -n +2 00:19:49.479 19:26:35 -- nvmf/common.sh@447 -- # head -n 1 00:19:49.479 19:26:35 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:49.479 19:26:35 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:49.479 19:26:35 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:49.479 19:26:35 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:49.479 19:26:35 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:49.479 19:26:35 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:49.479 19:26:35 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:19:49.479 19:26:35 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:49.479 19:26:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:49.479 19:26:35 -- common/autotest_common.sh@10 -- # set +x 00:19:49.479 19:26:35 -- nvmf/common.sh@470 -- # nvmfpid=3075907 00:19:49.479 19:26:35 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:49.479 19:26:35 -- nvmf/common.sh@471 -- # waitforlisten 3075907 00:19:49.479 19:26:35 -- common/autotest_common.sh@817 -- # '[' -z 3075907 ']' 00:19:49.479 19:26:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:49.479 19:26:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:49.479 19:26:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:49.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:49.479 19:26:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:49.479 19:26:35 -- common/autotest_common.sh@10 -- # set +x 00:19:49.479 [2024-04-24 19:26:36.043461] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:19:49.479 [2024-04-24 19:26:36.043523] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:49.479 EAL: No free 2048 kB hugepages reported on node 1 00:19:49.479 [2024-04-24 19:26:36.116202] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:49.479 [2024-04-24 19:26:36.202000] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:49.479 [2024-04-24 19:26:36.202044] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:49.479 [2024-04-24 19:26:36.202053] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:49.479 [2024-04-24 19:26:36.202062] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:49.479 [2024-04-24 19:26:36.202069] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:49.479 [2024-04-24 19:26:36.202127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:49.479 [2024-04-24 19:26:36.202214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:49.479 [2024-04-24 19:26:36.202276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:49.479 [2024-04-24 19:26:36.202277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:50.045 19:26:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:50.045 19:26:36 -- common/autotest_common.sh@850 -- # return 0 00:19:50.045 19:26:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:50.045 19:26:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:50.045 19:26:36 -- common/autotest_common.sh@10 -- # set +x 00:19:50.045 19:26:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:50.045 19:26:36 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:19:50.045 19:26:36 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:19:53.328 19:26:39 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:19:53.328 19:26:39 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:19:53.328 19:26:40 -- host/perf.sh@30 -- # local_nvme_trid=0000:5f:00.0 00:19:53.328 19:26:40 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:53.328 19:26:40 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:19:53.328 19:26:40 -- host/perf.sh@33 -- # '[' -n 0000:5f:00.0 ']' 00:19:53.328 19:26:40 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:19:53.328 19:26:40 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:19:53.328 19:26:40 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:19:53.587 [2024-04-24 19:26:40.477396] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:19:53.587 [2024-04-24 19:26:40.498753] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13bc530/0x13ea2c0) succeed. 00:19:53.587 [2024-04-24 19:26:40.509531] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x13bdb70/0x144a2c0) succeed. 00:19:53.846 19:26:40 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:53.846 19:26:40 -- host/perf.sh@45 -- # for bdev in $bdevs 00:19:53.846 19:26:40 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:54.105 19:26:41 -- host/perf.sh@45 -- # for bdev in $bdevs 00:19:54.105 19:26:41 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:19:54.363 19:26:41 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:54.363 [2024-04-24 19:26:41.370878] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:54.622 19:26:41 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:19:54.622 19:26:41 -- host/perf.sh@52 -- # '[' -n 0000:5f:00.0 ']' 00:19:54.622 19:26:41 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:19:54.622 19:26:41 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:19:54.622 19:26:41 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:19:55.996 Initializing NVMe Controllers 00:19:55.996 Attached to NVMe Controller at 0000:5f:00.0 [8086:0a54] 00:19:55.996 Associating PCIE (0000:5f:00.0) NSID 1 with lcore 0 00:19:55.996 Initialization complete. Launching workers. 00:19:55.996 ======================================================== 00:19:55.996 Latency(us) 00:19:55.996 Device Information : IOPS MiB/s Average min max 00:19:55.996 PCIE (0000:5f:00.0) NSID 1 from core 0: 98993.20 386.69 322.74 39.09 4373.02 00:19:55.996 ======================================================== 00:19:55.996 Total : 98993.20 386.69 322.74 39.09 4373.02 00:19:55.996 00:19:55.996 19:26:42 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:19:55.996 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.280 Initializing NVMe Controllers 00:19:59.280 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:19:59.280 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:59.280 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:19:59.280 Initialization complete. Launching workers. 00:19:59.280 ======================================================== 00:19:59.280 Latency(us) 00:19:59.280 Device Information : IOPS MiB/s Average min max 00:19:59.280 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6871.99 26.84 144.73 49.63 4083.64 00:19:59.280 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5324.99 20.80 186.83 68.54 4108.83 00:19:59.280 ======================================================== 00:19:59.280 Total : 12196.98 47.64 163.11 49.63 4108.83 00:19:59.280 00:19:59.280 19:26:46 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:19:59.280 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.472 Initializing NVMe Controllers 00:20:03.472 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:03.472 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:03.472 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:03.472 Initialization complete. Launching workers. 00:20:03.472 ======================================================== 00:20:03.472 Latency(us) 00:20:03.472 Device Information : IOPS MiB/s Average min max 00:20:03.472 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18416.98 71.94 1737.53 470.20 5490.66 00:20:03.472 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4032.00 15.75 7971.16 5788.02 10183.99 00:20:03.472 ======================================================== 00:20:03.472 Total : 22448.98 87.69 2857.13 470.20 10183.99 00:20:03.472 00:20:03.472 19:26:49 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:20:03.472 19:26:49 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:20:03.472 EAL: No free 2048 kB hugepages reported on node 1 00:20:07.668 Initializing NVMe Controllers 00:20:07.668 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:07.668 Controller IO queue size 128, less than required. 00:20:07.668 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:07.668 Controller IO queue size 128, less than required. 00:20:07.668 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:07.668 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:07.668 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:07.668 Initialization complete. Launching workers. 00:20:07.668 ======================================================== 00:20:07.668 Latency(us) 00:20:07.668 Device Information : IOPS MiB/s Average min max 00:20:07.668 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3412.00 853.00 37702.53 15418.06 86739.04 00:20:07.668 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3606.50 901.62 35161.20 15413.32 56783.29 00:20:07.668 ======================================================== 00:20:07.668 Total : 7018.50 1754.62 36396.65 15413.32 86739.04 00:20:07.668 00:20:07.668 19:26:53 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:20:07.668 EAL: No free 2048 kB hugepages reported on node 1 00:20:07.668 No valid NVMe controllers or AIO or URING devices found 00:20:07.668 Initializing NVMe Controllers 00:20:07.668 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:07.668 Controller IO queue size 128, less than required. 00:20:07.668 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:07.668 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:20:07.668 Controller IO queue size 128, less than required. 00:20:07.668 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:07.668 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:20:07.668 WARNING: Some requested NVMe devices were skipped 00:20:07.668 19:26:54 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:20:07.668 EAL: No free 2048 kB hugepages reported on node 1 00:20:11.866 Initializing NVMe Controllers 00:20:11.866 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:11.866 Controller IO queue size 128, less than required. 00:20:11.866 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:11.866 Controller IO queue size 128, less than required. 00:20:11.866 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:11.866 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:11.866 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:11.866 Initialization complete. Launching workers. 00:20:11.866 00:20:11.866 ==================== 00:20:11.866 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:20:11.866 RDMA transport: 00:20:11.866 dev name: mlx5_0 00:20:11.866 polls: 394858 00:20:11.866 idle_polls: 391686 00:20:11.866 completions: 42030 00:20:11.866 queued_requests: 1 00:20:11.866 total_send_wrs: 21015 00:20:11.866 send_doorbell_updates: 2880 00:20:11.866 total_recv_wrs: 21142 00:20:11.866 recv_doorbell_updates: 2899 00:20:11.866 --------------------------------- 00:20:11.866 00:20:11.866 ==================== 00:20:11.866 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:20:11.866 RDMA transport: 00:20:11.866 dev name: mlx5_0 00:20:11.866 polls: 397801 00:20:11.866 idle_polls: 397542 00:20:11.866 completions: 19938 00:20:11.866 queued_requests: 1 00:20:11.866 total_send_wrs: 9969 00:20:11.866 send_doorbell_updates: 252 00:20:11.866 total_recv_wrs: 10096 00:20:11.866 recv_doorbell_updates: 254 00:20:11.866 --------------------------------- 00:20:11.866 ======================================================== 00:20:11.866 Latency(us) 00:20:11.866 Device Information : IOPS MiB/s Average min max 00:20:11.866 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5253.50 1313.37 24400.63 11163.36 58534.33 00:20:11.866 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2492.00 623.00 51376.97 30460.27 85092.60 00:20:11.866 ======================================================== 00:20:11.866 Total : 7745.50 1936.37 33079.87 11163.36 85092.60 00:20:11.866 00:20:11.866 19:26:58 -- host/perf.sh@66 -- # sync 00:20:11.866 19:26:58 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:12.126 19:26:58 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:20:12.126 19:26:58 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:20:12.126 19:26:58 -- host/perf.sh@114 -- # nvmftestfini 00:20:12.126 19:26:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:12.126 19:26:58 -- nvmf/common.sh@117 -- # sync 00:20:12.126 19:26:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:12.126 19:26:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:12.126 19:26:58 -- nvmf/common.sh@120 -- # set +e 00:20:12.126 19:26:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:12.126 19:26:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:12.126 rmmod nvme_rdma 00:20:12.126 rmmod nvme_fabrics 00:20:12.126 19:26:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:12.126 19:26:58 -- nvmf/common.sh@124 -- # set -e 00:20:12.126 19:26:58 -- nvmf/common.sh@125 -- # return 0 00:20:12.126 19:26:58 -- nvmf/common.sh@478 -- # '[' -n 3075907 ']' 00:20:12.126 19:26:58 -- nvmf/common.sh@479 -- # killprocess 3075907 00:20:12.126 19:26:58 -- common/autotest_common.sh@936 -- # '[' -z 3075907 ']' 00:20:12.126 19:26:58 -- common/autotest_common.sh@940 -- # kill -0 3075907 00:20:12.126 19:26:58 -- common/autotest_common.sh@941 -- # uname 00:20:12.126 19:26:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:12.126 19:26:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3075907 00:20:12.126 19:26:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:12.126 19:26:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:12.126 19:26:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3075907' 00:20:12.126 killing process with pid 3075907 00:20:12.126 19:26:59 -- common/autotest_common.sh@955 -- # kill 3075907 00:20:12.126 19:26:59 -- common/autotest_common.sh@960 -- # wait 3075907 00:20:12.126 [2024-04-24 19:26:59.073158] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:14.659 19:27:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:14.659 19:27:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:14.659 00:20:14.659 real 0m32.051s 00:20:14.659 user 1m43.801s 00:20:14.659 sys 0m6.077s 00:20:14.659 19:27:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:14.659 19:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:14.659 ************************************ 00:20:14.659 END TEST nvmf_perf 00:20:14.659 ************************************ 00:20:14.918 19:27:01 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:20:14.918 19:27:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:14.918 19:27:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:14.918 19:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:14.918 ************************************ 00:20:14.918 START TEST nvmf_fio_host 00:20:14.918 ************************************ 00:20:14.918 19:27:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:20:14.918 * Looking for test storage... 00:20:14.918 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:14.918 19:27:01 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:14.918 19:27:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:14.918 19:27:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:14.918 19:27:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:14.918 19:27:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.918 19:27:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.918 19:27:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.918 19:27:01 -- paths/export.sh@5 -- # export PATH 00:20:14.919 19:27:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:14.919 19:27:01 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:15.178 19:27:01 -- nvmf/common.sh@7 -- # uname -s 00:20:15.178 19:27:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:15.178 19:27:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:15.178 19:27:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:15.178 19:27:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:15.178 19:27:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:15.178 19:27:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:15.178 19:27:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:15.178 19:27:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:15.178 19:27:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:15.178 19:27:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:15.178 19:27:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:20:15.178 19:27:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:20:15.178 19:27:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:15.178 19:27:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:15.178 19:27:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:15.178 19:27:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:15.178 19:27:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:15.178 19:27:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:15.178 19:27:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:15.178 19:27:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:15.178 19:27:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:15.178 19:27:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:15.178 19:27:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:15.178 19:27:01 -- paths/export.sh@5 -- # export PATH 00:20:15.178 19:27:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:15.178 19:27:01 -- nvmf/common.sh@47 -- # : 0 00:20:15.178 19:27:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:15.178 19:27:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:15.178 19:27:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:15.178 19:27:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:15.178 19:27:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:15.178 19:27:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:15.178 19:27:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:15.178 19:27:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:15.178 19:27:01 -- host/fio.sh@12 -- # nvmftestinit 00:20:15.178 19:27:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:15.178 19:27:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:15.178 19:27:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:15.178 19:27:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:15.178 19:27:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:15.178 19:27:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:15.178 19:27:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:15.178 19:27:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:15.178 19:27:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:15.178 19:27:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:15.178 19:27:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:15.178 19:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:21.746 19:27:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:21.746 19:27:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:21.746 19:27:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:21.746 19:27:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:21.746 19:27:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:21.746 19:27:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:21.746 19:27:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:21.746 19:27:07 -- nvmf/common.sh@295 -- # net_devs=() 00:20:21.746 19:27:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:21.746 19:27:07 -- nvmf/common.sh@296 -- # e810=() 00:20:21.746 19:27:07 -- nvmf/common.sh@296 -- # local -ga e810 00:20:21.746 19:27:07 -- nvmf/common.sh@297 -- # x722=() 00:20:21.746 19:27:07 -- nvmf/common.sh@297 -- # local -ga x722 00:20:21.746 19:27:07 -- nvmf/common.sh@298 -- # mlx=() 00:20:21.746 19:27:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:21.746 19:27:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:21.746 19:27:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:21.746 19:27:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:21.746 19:27:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:21.746 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:21.746 19:27:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:21.746 19:27:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:21.746 19:27:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:21.746 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:21.746 19:27:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:21.746 19:27:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:21.746 19:27:07 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:21.746 19:27:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:21.746 19:27:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:21.746 19:27:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:21.746 19:27:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:21.746 19:27:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:21.746 Found net devices under 0000:18:00.0: mlx_0_0 00:20:21.746 19:27:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:21.746 19:27:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:21.746 19:27:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:21.746 19:27:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:21.746 19:27:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:21.746 Found net devices under 0000:18:00.1: mlx_0_1 00:20:21.746 19:27:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:21.746 19:27:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:21.747 19:27:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:21.747 19:27:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:21.747 19:27:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:21.747 19:27:07 -- nvmf/common.sh@58 -- # uname 00:20:21.747 19:27:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:21.747 19:27:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:21.747 19:27:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:21.747 19:27:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:21.747 19:27:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:21.747 19:27:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:21.747 19:27:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:21.747 19:27:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:21.747 19:27:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:21.747 19:27:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:21.747 19:27:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:21.747 19:27:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:21.747 19:27:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:21.747 19:27:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:21.747 19:27:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:21.747 19:27:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:21.747 19:27:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@105 -- # continue 2 00:20:21.747 19:27:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@105 -- # continue 2 00:20:21.747 19:27:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:21.747 19:27:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:21.747 19:27:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:21.747 19:27:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:21.747 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:21.747 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:20:21.747 altname enp24s0f0np0 00:20:21.747 altname ens785f0np0 00:20:21.747 inet 192.168.100.8/24 scope global mlx_0_0 00:20:21.747 valid_lft forever preferred_lft forever 00:20:21.747 19:27:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:21.747 19:27:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:21.747 19:27:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:21.747 19:27:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:21.747 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:21.747 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:20:21.747 altname enp24s0f1np1 00:20:21.747 altname ens785f1np1 00:20:21.747 inet 192.168.100.9/24 scope global mlx_0_1 00:20:21.747 valid_lft forever preferred_lft forever 00:20:21.747 19:27:07 -- nvmf/common.sh@411 -- # return 0 00:20:21.747 19:27:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:21.747 19:27:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:21.747 19:27:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:21.747 19:27:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:21.747 19:27:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:21.747 19:27:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:21.747 19:27:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:21.747 19:27:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:21.747 19:27:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:21.747 19:27:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@105 -- # continue 2 00:20:21.747 19:27:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:21.747 19:27:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:21.747 19:27:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@105 -- # continue 2 00:20:21.747 19:27:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:21.747 19:27:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:21.747 19:27:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:21.747 19:27:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:21.747 19:27:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:21.747 19:27:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:21.747 192.168.100.9' 00:20:21.747 19:27:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:21.747 192.168.100.9' 00:20:21.747 19:27:07 -- nvmf/common.sh@446 -- # head -n 1 00:20:21.747 19:27:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:21.747 19:27:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:21.747 192.168.100.9' 00:20:21.747 19:27:07 -- nvmf/common.sh@447 -- # tail -n +2 00:20:21.747 19:27:07 -- nvmf/common.sh@447 -- # head -n 1 00:20:21.747 19:27:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:21.747 19:27:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:21.747 19:27:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:21.747 19:27:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:21.747 19:27:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:21.747 19:27:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:21.747 19:27:07 -- host/fio.sh@14 -- # [[ y != y ]] 00:20:21.747 19:27:07 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:20:21.747 19:27:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:21.747 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:20:21.747 19:27:07 -- host/fio.sh@22 -- # nvmfpid=3082625 00:20:21.747 19:27:07 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:21.747 19:27:07 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:21.747 19:27:07 -- host/fio.sh@26 -- # waitforlisten 3082625 00:20:21.747 19:27:07 -- common/autotest_common.sh@817 -- # '[' -z 3082625 ']' 00:20:21.747 19:27:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:21.747 19:27:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:21.747 19:27:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:21.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:21.747 19:27:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:21.747 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:20:21.747 [2024-04-24 19:27:07.937497] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:20:21.747 [2024-04-24 19:27:07.937560] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:21.747 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.747 [2024-04-24 19:27:08.009628] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:21.747 [2024-04-24 19:27:08.096095] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:21.747 [2024-04-24 19:27:08.096133] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:21.747 [2024-04-24 19:27:08.096142] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:21.747 [2024-04-24 19:27:08.096150] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:21.747 [2024-04-24 19:27:08.096157] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:21.747 [2024-04-24 19:27:08.096251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:21.747 [2024-04-24 19:27:08.096362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:21.747 [2024-04-24 19:27:08.096440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:21.747 [2024-04-24 19:27:08.096441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:21.747 19:27:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:21.747 19:27:08 -- common/autotest_common.sh@850 -- # return 0 00:20:21.747 19:27:08 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:21.747 19:27:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.747 19:27:08 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 [2024-04-24 19:27:08.785231] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a2b240/0x1a2f730) succeed. 00:20:22.006 [2024-04-24 19:27:08.795802] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a2c880/0x1a70dc0) succeed. 00:20:22.006 19:27:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.006 19:27:08 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:20:22.006 19:27:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:22.006 19:27:08 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 19:27:08 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:22.006 19:27:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.006 19:27:08 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 Malloc1 00:20:22.006 19:27:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.006 19:27:08 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:22.006 19:27:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.006 19:27:08 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 19:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.006 19:27:09 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:22.006 19:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.006 19:27:09 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 19:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.006 19:27:09 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:22.006 19:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.006 19:27:09 -- common/autotest_common.sh@10 -- # set +x 00:20:22.006 [2024-04-24 19:27:09.018761] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:22.006 19:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.006 19:27:09 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:20:22.007 19:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.007 19:27:09 -- common/autotest_common.sh@10 -- # set +x 00:20:22.275 19:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.275 19:27:09 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:20:22.275 19:27:09 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:22.275 19:27:09 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:22.275 19:27:09 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:20:22.275 19:27:09 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:20:22.275 19:27:09 -- common/autotest_common.sh@1325 -- # local sanitizers 00:20:22.275 19:27:09 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:22.275 19:27:09 -- common/autotest_common.sh@1327 -- # shift 00:20:22.275 19:27:09 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:20:22.275 19:27:09 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # grep libasan 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # asan_lib= 00:20:22.275 19:27:09 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:20:22.275 19:27:09 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:20:22.275 19:27:09 -- common/autotest_common.sh@1331 -- # asan_lib= 00:20:22.275 19:27:09 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:20:22.275 19:27:09 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:20:22.275 19:27:09 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:22.533 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:20:22.533 fio-3.35 00:20:22.533 Starting 1 thread 00:20:22.533 EAL: No free 2048 kB hugepages reported on node 1 00:20:25.059 00:20:25.059 test: (groupid=0, jobs=1): err= 0: pid=3082924: Wed Apr 24 19:27:11 2024 00:20:25.060 read: IOPS=17.6k, BW=68.8MiB/s (72.1MB/s)(138MiB/2004msec) 00:20:25.060 slat (nsec): min=1394, max=30786, avg=1549.61, stdev=478.87 00:20:25.060 clat (usec): min=1966, max=6761, avg=3609.18, stdev=112.81 00:20:25.060 lat (usec): min=1986, max=6763, avg=3610.73, stdev=112.77 00:20:25.060 clat percentiles (usec): 00:20:25.060 | 1.00th=[ 3261], 5.00th=[ 3556], 10.00th=[ 3589], 20.00th=[ 3589], 00:20:25.060 | 30.00th=[ 3589], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 3621], 00:20:25.060 | 70.00th=[ 3621], 80.00th=[ 3621], 90.00th=[ 3621], 95.00th=[ 3654], 00:20:25.060 | 99.00th=[ 3949], 99.50th=[ 4178], 99.90th=[ 4948], 99.95th=[ 5866], 00:20:25.060 | 99.99th=[ 6325] 00:20:25.060 bw ( KiB/s): min=68536, max=71136, per=99.99%, avg=70406.00, stdev=1254.47, samples=4 00:20:25.060 iops : min=17134, max=17784, avg=17601.50, stdev=313.62, samples=4 00:20:25.060 write: IOPS=17.6k, BW=68.8MiB/s (72.1MB/s)(138MiB/2004msec); 0 zone resets 00:20:25.060 slat (nsec): min=1445, max=26897, avg=1872.15, stdev=521.41 00:20:25.060 clat (usec): min=1997, max=6777, avg=3607.86, stdev=111.95 00:20:25.060 lat (usec): min=2008, max=6779, avg=3609.73, stdev=111.91 00:20:25.060 clat percentiles (usec): 00:20:25.060 | 1.00th=[ 3261], 5.00th=[ 3556], 10.00th=[ 3589], 20.00th=[ 3589], 00:20:25.060 | 30.00th=[ 3589], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 3621], 00:20:25.060 | 70.00th=[ 3621], 80.00th=[ 3621], 90.00th=[ 3621], 95.00th=[ 3654], 00:20:25.060 | 99.00th=[ 3949], 99.50th=[ 4146], 99.90th=[ 4555], 99.95th=[ 5866], 00:20:25.060 | 99.99th=[ 6718] 00:20:25.060 bw ( KiB/s): min=68656, max=71248, per=100.00%, avg=70462.00, stdev=1212.00, samples=4 00:20:25.060 iops : min=17164, max=17810, avg=17615.50, stdev=302.82, samples=4 00:20:25.060 lat (msec) : 2=0.01%, 4=99.40%, 10=0.59% 00:20:25.060 cpu : usr=99.50%, sys=0.05%, ctx=17, majf=0, minf=3 00:20:25.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:20:25.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:25.060 issued rwts: total=35277,35284,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.060 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:25.060 00:20:25.060 Run status group 0 (all jobs): 00:20:25.060 READ: bw=68.8MiB/s (72.1MB/s), 68.8MiB/s-68.8MiB/s (72.1MB/s-72.1MB/s), io=138MiB (144MB), run=2004-2004msec 00:20:25.060 WRITE: bw=68.8MiB/s (72.1MB/s), 68.8MiB/s-68.8MiB/s (72.1MB/s-72.1MB/s), io=138MiB (145MB), run=2004-2004msec 00:20:25.060 19:27:11 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:25.060 19:27:11 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:25.060 19:27:11 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:20:25.060 19:27:11 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:20:25.060 19:27:11 -- common/autotest_common.sh@1325 -- # local sanitizers 00:20:25.060 19:27:11 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:25.060 19:27:11 -- common/autotest_common.sh@1327 -- # shift 00:20:25.060 19:27:11 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:20:25.060 19:27:11 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # grep libasan 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # asan_lib= 00:20:25.060 19:27:11 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:20:25.060 19:27:11 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:20:25.060 19:27:11 -- common/autotest_common.sh@1331 -- # asan_lib= 00:20:25.060 19:27:11 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:20:25.060 19:27:11 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:20:25.060 19:27:11 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:25.060 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:20:25.060 fio-3.35 00:20:25.060 Starting 1 thread 00:20:25.060 EAL: No free 2048 kB hugepages reported on node 1 00:20:27.676 00:20:27.676 test: (groupid=0, jobs=1): err= 0: pid=3083378: Wed Apr 24 19:27:14 2024 00:20:27.676 read: IOPS=12.9k, BW=201MiB/s (211MB/s)(396MiB/1967msec) 00:20:27.676 slat (nsec): min=2332, max=50160, avg=2692.25, stdev=1002.04 00:20:27.676 clat (usec): min=285, max=7714, avg=1711.47, stdev=972.47 00:20:27.676 lat (usec): min=288, max=7745, avg=1714.17, stdev=972.96 00:20:27.676 clat percentiles (usec): 00:20:27.676 | 1.00th=[ 611], 5.00th=[ 848], 10.00th=[ 979], 20.00th=[ 1139], 00:20:27.676 | 30.00th=[ 1254], 40.00th=[ 1369], 50.00th=[ 1483], 60.00th=[ 1598], 00:20:27.676 | 70.00th=[ 1762], 80.00th=[ 1991], 90.00th=[ 2409], 95.00th=[ 3884], 00:20:27.676 | 99.00th=[ 5800], 99.50th=[ 6915], 99.90th=[ 7308], 99.95th=[ 7439], 00:20:27.676 | 99.99th=[ 7635] 00:20:27.676 bw ( KiB/s): min=99200, max=103328, per=49.14%, avg=101336.00, stdev=1732.22, samples=4 00:20:27.676 iops : min= 6200, max= 6458, avg=6333.50, stdev=108.26, samples=4 00:20:27.676 write: IOPS=7064, BW=110MiB/s (116MB/s)(206MiB/1868msec); 0 zone resets 00:20:27.676 slat (usec): min=27, max=123, avg=30.26, stdev= 5.62 00:20:27.676 clat (usec): min=4652, max=20231, avg=14225.44, stdev=1921.24 00:20:27.676 lat (usec): min=4682, max=20260, avg=14255.69, stdev=1920.59 00:20:27.676 clat percentiles (usec): 00:20:27.676 | 1.00th=[ 7439], 5.00th=[11338], 10.00th=[11994], 20.00th=[12780], 00:20:27.676 | 30.00th=[13435], 40.00th=[13829], 50.00th=[14222], 60.00th=[14746], 00:20:27.676 | 70.00th=[15139], 80.00th=[15664], 90.00th=[16450], 95.00th=[17171], 00:20:27.676 | 99.00th=[18482], 99.50th=[19268], 99.90th=[20055], 99.95th=[20055], 00:20:27.676 | 99.99th=[20317] 00:20:27.676 bw ( KiB/s): min=101440, max=107104, per=92.68%, avg=104752.00, stdev=2385.88, samples=4 00:20:27.676 iops : min= 6340, max= 6694, avg=6547.00, stdev=149.12, samples=4 00:20:27.676 lat (usec) : 500=0.23%, 750=1.63%, 1000=5.34% 00:20:27.676 lat (msec) : 2=45.76%, 4=9.69%, 10=3.68%, 20=33.63%, 50=0.04% 00:20:27.676 cpu : usr=96.46%, sys=1.85%, ctx=184, majf=0, minf=2 00:20:27.676 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:20:27.676 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:27.676 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:27.676 issued rwts: total=25352,13196,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:27.676 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:27.676 00:20:27.676 Run status group 0 (all jobs): 00:20:27.676 READ: bw=201MiB/s (211MB/s), 201MiB/s-201MiB/s (211MB/s-211MB/s), io=396MiB (415MB), run=1967-1967msec 00:20:27.676 WRITE: bw=110MiB/s (116MB/s), 110MiB/s-110MiB/s (116MB/s-116MB/s), io=206MiB (216MB), run=1868-1868msec 00:20:27.676 19:27:14 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:27.676 19:27:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.676 19:27:14 -- common/autotest_common.sh@10 -- # set +x 00:20:27.676 19:27:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.676 19:27:14 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:20:27.676 19:27:14 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:20:27.676 19:27:14 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:20:27.676 19:27:14 -- host/fio.sh@84 -- # nvmftestfini 00:20:27.676 19:27:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:27.676 19:27:14 -- nvmf/common.sh@117 -- # sync 00:20:27.676 19:27:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:27.676 19:27:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:27.676 19:27:14 -- nvmf/common.sh@120 -- # set +e 00:20:27.676 19:27:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:27.676 19:27:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:27.676 rmmod nvme_rdma 00:20:27.676 rmmod nvme_fabrics 00:20:27.676 19:27:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:27.676 19:27:14 -- nvmf/common.sh@124 -- # set -e 00:20:27.676 19:27:14 -- nvmf/common.sh@125 -- # return 0 00:20:27.676 19:27:14 -- nvmf/common.sh@478 -- # '[' -n 3082625 ']' 00:20:27.676 19:27:14 -- nvmf/common.sh@479 -- # killprocess 3082625 00:20:27.676 19:27:14 -- common/autotest_common.sh@936 -- # '[' -z 3082625 ']' 00:20:27.676 19:27:14 -- common/autotest_common.sh@940 -- # kill -0 3082625 00:20:27.676 19:27:14 -- common/autotest_common.sh@941 -- # uname 00:20:27.676 19:27:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.676 19:27:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3082625 00:20:27.676 19:27:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:27.676 19:27:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:27.676 19:27:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3082625' 00:20:27.676 killing process with pid 3082625 00:20:27.676 19:27:14 -- common/autotest_common.sh@955 -- # kill 3082625 00:20:27.676 19:27:14 -- common/autotest_common.sh@960 -- # wait 3082625 00:20:27.676 [2024-04-24 19:27:14.578591] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:27.935 19:27:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:27.935 19:27:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:27.935 00:20:27.935 real 0m12.973s 00:20:27.935 user 0m37.604s 00:20:27.935 sys 0m5.393s 00:20:27.935 19:27:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:27.935 19:27:14 -- common/autotest_common.sh@10 -- # set +x 00:20:27.935 ************************************ 00:20:27.935 END TEST nvmf_fio_host 00:20:27.935 ************************************ 00:20:27.935 19:27:14 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:20:27.935 19:27:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:27.935 19:27:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:27.935 19:27:14 -- common/autotest_common.sh@10 -- # set +x 00:20:28.194 ************************************ 00:20:28.194 START TEST nvmf_failover 00:20:28.194 ************************************ 00:20:28.194 19:27:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:20:28.194 * Looking for test storage... 00:20:28.194 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:28.194 19:27:15 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:28.194 19:27:15 -- nvmf/common.sh@7 -- # uname -s 00:20:28.194 19:27:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:28.194 19:27:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:28.194 19:27:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:28.194 19:27:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:28.194 19:27:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:28.194 19:27:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:28.194 19:27:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:28.194 19:27:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:28.194 19:27:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:28.194 19:27:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:28.194 19:27:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:20:28.194 19:27:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:20:28.194 19:27:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:28.194 19:27:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:28.194 19:27:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:28.194 19:27:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:28.194 19:27:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:28.194 19:27:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:28.194 19:27:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:28.194 19:27:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:28.194 19:27:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:28.194 19:27:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:28.194 19:27:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:28.194 19:27:15 -- paths/export.sh@5 -- # export PATH 00:20:28.194 19:27:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:28.194 19:27:15 -- nvmf/common.sh@47 -- # : 0 00:20:28.194 19:27:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:28.194 19:27:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:28.194 19:27:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:28.194 19:27:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:28.194 19:27:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:28.194 19:27:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:28.194 19:27:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:28.194 19:27:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:28.194 19:27:15 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:28.194 19:27:15 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:28.194 19:27:15 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:20:28.194 19:27:15 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:28.194 19:27:15 -- host/failover.sh@18 -- # nvmftestinit 00:20:28.194 19:27:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:28.194 19:27:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:28.194 19:27:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:28.194 19:27:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:28.194 19:27:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:28.194 19:27:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:28.194 19:27:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:28.194 19:27:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:28.194 19:27:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:28.194 19:27:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:28.194 19:27:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:28.194 19:27:15 -- common/autotest_common.sh@10 -- # set +x 00:20:34.759 19:27:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:34.759 19:27:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:34.759 19:27:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:34.759 19:27:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:34.759 19:27:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:34.759 19:27:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:34.759 19:27:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:34.759 19:27:20 -- nvmf/common.sh@295 -- # net_devs=() 00:20:34.759 19:27:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:34.759 19:27:20 -- nvmf/common.sh@296 -- # e810=() 00:20:34.759 19:27:20 -- nvmf/common.sh@296 -- # local -ga e810 00:20:34.759 19:27:20 -- nvmf/common.sh@297 -- # x722=() 00:20:34.759 19:27:20 -- nvmf/common.sh@297 -- # local -ga x722 00:20:34.759 19:27:20 -- nvmf/common.sh@298 -- # mlx=() 00:20:34.759 19:27:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:34.759 19:27:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:34.759 19:27:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:34.759 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:34.759 19:27:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:34.759 19:27:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:34.759 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:34.759 19:27:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:34.759 19:27:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:34.759 19:27:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:34.759 19:27:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:34.759 Found net devices under 0000:18:00.0: mlx_0_0 00:20:34.759 19:27:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:34.759 19:27:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:34.759 19:27:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:34.759 Found net devices under 0000:18:00.1: mlx_0_1 00:20:34.759 19:27:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:34.759 19:27:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:34.759 19:27:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:34.759 19:27:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:34.759 19:27:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:34.759 19:27:20 -- nvmf/common.sh@58 -- # uname 00:20:34.759 19:27:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:34.759 19:27:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:34.759 19:27:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:34.759 19:27:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:34.759 19:27:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:34.759 19:27:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:34.759 19:27:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:34.759 19:27:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:34.759 19:27:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:34.759 19:27:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:34.759 19:27:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:34.759 19:27:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:34.759 19:27:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:34.759 19:27:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:34.759 19:27:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:34.759 19:27:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:34.759 19:27:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.759 19:27:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:34.760 19:27:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:34.760 19:27:20 -- nvmf/common.sh@105 -- # continue 2 00:20:34.760 19:27:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:34.760 19:27:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.760 19:27:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:34.760 19:27:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.760 19:27:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:34.760 19:27:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:34.760 19:27:20 -- nvmf/common.sh@105 -- # continue 2 00:20:34.760 19:27:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:34.760 19:27:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:34.760 19:27:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:34.760 19:27:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:34.760 19:27:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:34.760 19:27:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:34.760 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:34.760 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:20:34.760 altname enp24s0f0np0 00:20:34.760 altname ens785f0np0 00:20:34.760 inet 192.168.100.8/24 scope global mlx_0_0 00:20:34.760 valid_lft forever preferred_lft forever 00:20:34.760 19:27:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:34.760 19:27:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:34.760 19:27:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:34.760 19:27:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:34.760 19:27:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:34.760 19:27:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:34.760 19:27:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:34.760 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:34.760 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:20:34.760 altname enp24s0f1np1 00:20:34.760 altname ens785f1np1 00:20:34.760 inet 192.168.100.9/24 scope global mlx_0_1 00:20:34.760 valid_lft forever preferred_lft forever 00:20:34.760 19:27:21 -- nvmf/common.sh@411 -- # return 0 00:20:34.760 19:27:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:34.760 19:27:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:34.760 19:27:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:34.760 19:27:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:34.760 19:27:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:34.760 19:27:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:34.760 19:27:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:34.760 19:27:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:34.760 19:27:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:34.760 19:27:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:34.760 19:27:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:34.760 19:27:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.760 19:27:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:34.760 19:27:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:34.760 19:27:21 -- nvmf/common.sh@105 -- # continue 2 00:20:34.760 19:27:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:34.760 19:27:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.760 19:27:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:34.760 19:27:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:34.760 19:27:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:34.760 19:27:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:34.760 19:27:21 -- nvmf/common.sh@105 -- # continue 2 00:20:34.760 19:27:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:34.760 19:27:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:34.760 19:27:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:34.760 19:27:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:34.760 19:27:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:34.760 19:27:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:34.760 19:27:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:34.760 19:27:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:34.760 192.168.100.9' 00:20:34.760 19:27:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:34.760 192.168.100.9' 00:20:34.760 19:27:21 -- nvmf/common.sh@446 -- # head -n 1 00:20:34.760 19:27:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:34.760 19:27:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:34.760 192.168.100.9' 00:20:34.760 19:27:21 -- nvmf/common.sh@447 -- # tail -n +2 00:20:34.760 19:27:21 -- nvmf/common.sh@447 -- # head -n 1 00:20:34.760 19:27:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:34.760 19:27:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:34.760 19:27:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:34.760 19:27:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:34.760 19:27:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:34.760 19:27:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:34.760 19:27:21 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:20:34.760 19:27:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:34.760 19:27:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:34.760 19:27:21 -- common/autotest_common.sh@10 -- # set +x 00:20:34.760 19:27:21 -- nvmf/common.sh@470 -- # nvmfpid=3086618 00:20:34.760 19:27:21 -- nvmf/common.sh@471 -- # waitforlisten 3086618 00:20:34.760 19:27:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:20:34.760 19:27:21 -- common/autotest_common.sh@817 -- # '[' -z 3086618 ']' 00:20:34.760 19:27:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:34.760 19:27:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:34.760 19:27:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:34.760 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:34.760 19:27:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:34.760 19:27:21 -- common/autotest_common.sh@10 -- # set +x 00:20:34.760 [2024-04-24 19:27:21.157529] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:20:34.760 [2024-04-24 19:27:21.157583] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:34.760 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.760 [2024-04-24 19:27:21.228496] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:34.760 [2024-04-24 19:27:21.318395] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:34.760 [2024-04-24 19:27:21.318434] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:34.760 [2024-04-24 19:27:21.318444] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:34.760 [2024-04-24 19:27:21.318468] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:34.760 [2024-04-24 19:27:21.318476] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:34.760 [2024-04-24 19:27:21.318592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.760 [2024-04-24 19:27:21.318646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:34.760 [2024-04-24 19:27:21.318647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:35.018 19:27:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:35.018 19:27:21 -- common/autotest_common.sh@850 -- # return 0 00:20:35.018 19:27:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:35.018 19:27:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:35.018 19:27:21 -- common/autotest_common.sh@10 -- # set +x 00:20:35.018 19:27:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:35.018 19:27:22 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:35.277 [2024-04-24 19:27:22.207706] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12ada30/0x12b1f20) succeed. 00:20:35.277 [2024-04-24 19:27:22.218155] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x12aefd0/0x12f35b0) succeed. 00:20:35.536 19:27:22 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:20:35.536 Malloc0 00:20:35.795 19:27:22 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:35.795 19:27:22 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:36.053 19:27:22 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:36.311 [2024-04-24 19:27:23.081588] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:36.311 19:27:23 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:20:36.311 [2024-04-24 19:27:23.249891] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:20:36.311 19:27:23 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:20:36.570 [2024-04-24 19:27:23.426502] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:20:36.570 19:27:23 -- host/failover.sh@31 -- # bdevperf_pid=3086855 00:20:36.570 19:27:23 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:36.570 19:27:23 -- host/failover.sh@34 -- # waitforlisten 3086855 /var/tmp/bdevperf.sock 00:20:36.570 19:27:23 -- common/autotest_common.sh@817 -- # '[' -z 3086855 ']' 00:20:36.570 19:27:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.570 19:27:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:36.570 19:27:23 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:20:36.570 19:27:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.570 19:27:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:36.570 19:27:23 -- common/autotest_common.sh@10 -- # set +x 00:20:37.503 19:27:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:37.503 19:27:24 -- common/autotest_common.sh@850 -- # return 0 00:20:37.503 19:27:24 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:37.761 NVMe0n1 00:20:37.761 19:27:24 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:38.019 00:20:38.019 19:27:24 -- host/failover.sh@39 -- # run_test_pid=3087038 00:20:38.019 19:27:24 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:38.019 19:27:24 -- host/failover.sh@41 -- # sleep 1 00:20:38.953 19:27:25 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:39.211 19:27:26 -- host/failover.sh@45 -- # sleep 3 00:20:42.497 19:27:29 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:42.497 00:20:42.497 19:27:29 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:20:42.497 19:27:29 -- host/failover.sh@50 -- # sleep 3 00:20:45.780 19:27:32 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:45.780 [2024-04-24 19:27:32.649417] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:45.780 19:27:32 -- host/failover.sh@55 -- # sleep 1 00:20:46.715 19:27:33 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:20:46.973 19:27:33 -- host/failover.sh@59 -- # wait 3087038 00:20:53.536 0 00:20:53.536 19:27:39 -- host/failover.sh@61 -- # killprocess 3086855 00:20:53.536 19:27:39 -- common/autotest_common.sh@936 -- # '[' -z 3086855 ']' 00:20:53.536 19:27:39 -- common/autotest_common.sh@940 -- # kill -0 3086855 00:20:53.536 19:27:39 -- common/autotest_common.sh@941 -- # uname 00:20:53.536 19:27:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:53.536 19:27:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3086855 00:20:53.536 19:27:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:53.536 19:27:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:53.536 19:27:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3086855' 00:20:53.536 killing process with pid 3086855 00:20:53.536 19:27:40 -- common/autotest_common.sh@955 -- # kill 3086855 00:20:53.536 19:27:40 -- common/autotest_common.sh@960 -- # wait 3086855 00:20:53.536 19:27:40 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:20:53.536 [2024-04-24 19:27:23.498529] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:20:53.536 [2024-04-24 19:27:23.498599] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3086855 ] 00:20:53.536 EAL: No free 2048 kB hugepages reported on node 1 00:20:53.536 [2024-04-24 19:27:23.571975] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.536 [2024-04-24 19:27:23.659768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:53.536 Running I/O for 15 seconds... 00:20:53.536 [2024-04-24 19:27:26.994718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:24088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.536 [2024-04-24 19:27:26.994875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.536 [2024-04-24 19:27:26.994886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:24112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.994895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.994906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.994915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.994926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:24128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.994935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.994946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:24136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.994955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.994966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:24144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.994981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.994992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:24152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:24160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:24168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:24176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:24192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:24200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:24216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:24224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:24232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:24240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:24256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:24272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:24280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:24288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:24312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:24320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:24344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:24352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:24360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:24376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:24392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.537 [2024-04-24 19:27:26.995621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.537 [2024-04-24 19:27:26.995631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:24408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:24424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:24440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:24448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:24456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:24464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:24480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:24496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:24504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:24512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:24528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.995983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.995993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.996013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.996032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.538 [2024-04-24 19:27:26.996053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:23568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:23592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:23640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:23664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.538 [2024-04-24 19:27:26.996392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x3b700 00:20:53.538 [2024-04-24 19:27:26.996401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:23688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:23712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:23760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:23768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:23776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:23784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:23792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:23800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:23808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:23816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:23824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:23832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:23840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:23848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:23856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:23864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:23872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:23880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:23888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:23896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:23904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.996983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.996994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:23912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.997003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.997014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:23920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.997023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.997035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:23928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x3b700 00:20:53.539 [2024-04-24 19:27:26.997044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.539 [2024-04-24 19:27:26.997055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:23936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:23944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:23952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:23960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:23968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:23976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:23984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:23992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:24016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:24024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:24032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:24040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.997342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:24048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x3b700 00:20:53.540 [2024-04-24 19:27:26.997351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.999090] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:20:53.540 [2024-04-24 19:27:26.999104] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:20:53.540 [2024-04-24 19:27:26.999116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24056 len:8 PRP1 0x0 PRP2 0x0 00:20:53.540 [2024-04-24 19:27:26.999126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:26.999167] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:20:53.540 [2024-04-24 19:27:26.999179] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:20:53.540 [2024-04-24 19:27:26.999189] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:53.540 [2024-04-24 19:27:27.001972] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:53.540 [2024-04-24 19:27:27.016634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:53.540 [2024-04-24 19:27:27.062225] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:53.540 [2024-04-24 19:27:30.461881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:119712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.461925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.461946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:119720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.461956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.461968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:119728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.461977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.461988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:119736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.461998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:119744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:119752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:119760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:119768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:119776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:119784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:119792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:119800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:119808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:119816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:119824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:119832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:119840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:119848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.540 [2024-04-24 19:27:30.462287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.540 [2024-04-24 19:27:30.462298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:119856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:119864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:119872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:119880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:119888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:119896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:119912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:119920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:119480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3b700 00:20:53.541 [2024-04-24 19:27:30.462490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:119488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3b700 00:20:53.541 [2024-04-24 19:27:30.462511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:119496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3b700 00:20:53.541 [2024-04-24 19:27:30.462531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:119928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:119936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:119944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:119952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:119960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:119968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:119976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:119984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:119992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:120000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:120008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:120016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:120024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:120032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:120040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:120048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:120056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:120064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:120072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.541 [2024-04-24 19:27:30.462919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.541 [2024-04-24 19:27:30.462930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:120080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.462939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.462950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:120088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.462959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.462970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:120096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.462980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.462991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:120104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:120112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:120120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:120128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:120136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:120144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:120152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:120160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:120168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:120176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:119504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:119512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:119520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:119528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:119536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:120184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:120192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:120200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:120208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:120216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:120224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:120232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:120240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:119544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:119552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:119560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:119568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:119576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:119584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:119592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:119600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3b700 00:20:53.542 [2024-04-24 19:27:30.463611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:120248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:120256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:120264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:120272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.542 [2024-04-24 19:27:30.463691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.542 [2024-04-24 19:27:30.463702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:120280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:120288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:120296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:120304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:119608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.463791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:119616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.463811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:119624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.463833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:120312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:120320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:120328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:120336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:120344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:120352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:120360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.463984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:120368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.463993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:119632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:119640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:119648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:119656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:119664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:120376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:120384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:120392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:120400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:120408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:120416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:120424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:120432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:120440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:120448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:120456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:120464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:120472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:120480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:120488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:120496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.543 [2024-04-24 19:27:30.464422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:119672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:119680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.543 [2024-04-24 19:27:30.464475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:119688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x3b700 00:20:53.543 [2024-04-24 19:27:30.464484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:30.464495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:119696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:30.464504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:30.466277] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:20:53.544 [2024-04-24 19:27:30.466291] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:20:53.544 [2024-04-24 19:27:30.466300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:119704 len:8 PRP1 0x0 PRP2 0x0 00:20:53.544 [2024-04-24 19:27:30.466310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:30.466357] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:20:53.544 [2024-04-24 19:27:30.466370] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:20:53.544 [2024-04-24 19:27:30.466380] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:53.544 [2024-04-24 19:27:30.469160] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:53.544 [2024-04-24 19:27:30.483675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:53.544 [2024-04-24 19:27:30.527031] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:53.544 [2024-04-24 19:27:34.848275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:92472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:92480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:92488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:92496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:92504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:92512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:92520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:92528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:92536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:92544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:92016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:92024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:92032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:92040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:92048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:92056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:92064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:92072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3b700 00:20:53.544 [2024-04-24 19:27:34.848690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:92552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:92560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:92568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:92576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:92584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:92592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:92600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:92608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:92616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:92624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:92632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:92640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:92648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.544 [2024-04-24 19:27:34.848955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.544 [2024-04-24 19:27:34.848965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:92656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.848974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.848985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:92664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.848994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:92672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:92680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:92688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:92696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:92704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:92712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:92080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:92088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:92096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:92104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:92112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:92120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:92128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:92136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:92144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:92152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:92160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:92168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:92176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:92184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:92192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:92200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x3b700 00:20:53.545 [2024-04-24 19:27:34.849441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:92720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:92728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:92736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:92744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.545 [2024-04-24 19:27:34.849525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.545 [2024-04-24 19:27:34.849535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:92752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:92760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:92768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:92776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:92784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:92792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:92800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:92808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:92816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:92824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:92832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:92840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:92848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:92856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:92864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:92872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:92880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:92888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:92896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:92904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.849932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:92208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3b700 00:20:53.546 [2024-04-24 19:27:34.849952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:92216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3b700 00:20:53.546 [2024-04-24 19:27:34.849973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.849985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:92224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x3b700 00:20:53.546 [2024-04-24 19:27:34.849995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:92912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:92920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:92928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:92936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:92944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:92952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:92960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:92968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:92976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:92984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:92992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:93000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:93008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:93016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.546 [2024-04-24 19:27:34.850277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.546 [2024-04-24 19:27:34.850287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:93024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.547 [2024-04-24 19:27:34.850297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:93032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:20:53.547 [2024-04-24 19:27:34.850318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:92232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:92240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:92248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:92256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:92264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:92272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:92280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:92288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:92296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:92304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:92312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:92320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:92328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:92336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:92344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:92352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:92360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:92368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:92376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:92384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:92392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:92400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:92408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:92416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:92424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:92432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:92440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:92448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.850911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:92456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x3b700 00:20:53.547 [2024-04-24 19:27:34.850920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:8da0 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.852683] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:20:53.547 [2024-04-24 19:27:34.852697] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:20:53.547 [2024-04-24 19:27:34.852709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:92464 len:8 PRP1 0x0 PRP2 0x0 00:20:53.547 [2024-04-24 19:27:34.852720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:53.547 [2024-04-24 19:27:34.852765] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:20:53.547 [2024-04-24 19:27:34.852778] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:20:53.547 [2024-04-24 19:27:34.852788] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:53.547 [2024-04-24 19:27:34.855570] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:53.547 [2024-04-24 19:27:34.869730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:53.547 [2024-04-24 19:27:34.909323] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:53.547 00:20:53.547 Latency(us) 00:20:53.548 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:53.548 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:20:53.548 Verification LBA range: start 0x0 length 0x4000 00:20:53.548 NVMe0n1 : 15.01 14340.13 56.02 294.62 0.00 8724.63 352.61 1013927.40 00:20:53.548 =================================================================================================================== 00:20:53.548 Total : 14340.13 56.02 294.62 0.00 8724.63 352.61 1013927.40 00:20:53.548 Received shutdown signal, test time was about 15.000000 seconds 00:20:53.548 00:20:53.548 Latency(us) 00:20:53.548 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:53.548 =================================================================================================================== 00:20:53.548 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:53.548 19:27:40 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:20:53.548 19:27:40 -- host/failover.sh@65 -- # count=3 00:20:53.548 19:27:40 -- host/failover.sh@67 -- # (( count != 3 )) 00:20:53.548 19:27:40 -- host/failover.sh@73 -- # bdevperf_pid=3089048 00:20:53.548 19:27:40 -- host/failover.sh@75 -- # waitforlisten 3089048 /var/tmp/bdevperf.sock 00:20:53.548 19:27:40 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:20:53.548 19:27:40 -- common/autotest_common.sh@817 -- # '[' -z 3089048 ']' 00:20:53.548 19:27:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:53.548 19:27:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:53.548 19:27:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:53.548 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:53.548 19:27:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:53.548 19:27:40 -- common/autotest_common.sh@10 -- # set +x 00:20:54.485 19:27:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:54.485 19:27:41 -- common/autotest_common.sh@850 -- # return 0 00:20:54.485 19:27:41 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:20:54.485 [2024-04-24 19:27:41.323616] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:20:54.485 19:27:41 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:20:54.485 [2024-04-24 19:27:41.496222] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:20:54.743 19:27:41 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:55.001 NVMe0n1 00:20:55.001 19:27:41 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:55.001 00:20:55.260 19:27:42 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:55.260 00:20:55.260 19:27:42 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:20:55.260 19:27:42 -- host/failover.sh@82 -- # grep -q NVMe0 00:20:55.518 19:27:42 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:55.776 19:27:42 -- host/failover.sh@87 -- # sleep 3 00:20:59.056 19:27:45 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:20:59.056 19:27:45 -- host/failover.sh@88 -- # grep -q NVMe0 00:20:59.056 19:27:45 -- host/failover.sh@90 -- # run_test_pid=3089794 00:20:59.056 19:27:45 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:59.056 19:27:45 -- host/failover.sh@92 -- # wait 3089794 00:20:59.993 0 00:20:59.993 19:27:46 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:20:59.993 [2024-04-24 19:27:40.334825] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:20:59.993 [2024-04-24 19:27:40.334891] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3089048 ] 00:20:59.993 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.993 [2024-04-24 19:27:40.411018] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.993 [2024-04-24 19:27:40.491239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:59.993 [2024-04-24 19:27:42.618714] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:20:59.993 [2024-04-24 19:27:42.619259] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:59.993 [2024-04-24 19:27:42.619292] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:59.993 [2024-04-24 19:27:42.639778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:59.993 [2024-04-24 19:27:42.655861] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:59.993 Running I/O for 1 seconds... 00:20:59.993 00:20:59.993 Latency(us) 00:20:59.993 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.993 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:20:59.993 Verification LBA range: start 0x0 length 0x4000 00:20:59.993 NVMe0n1 : 1.01 18049.58 70.51 0.00 0.00 7052.97 2550.21 12708.29 00:20:59.993 =================================================================================================================== 00:20:59.993 Total : 18049.58 70.51 0.00 0.00 7052.97 2550.21 12708.29 00:20:59.993 19:27:46 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:20:59.993 19:27:46 -- host/failover.sh@95 -- # grep -q NVMe0 00:21:00.252 19:27:47 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:00.510 19:27:47 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:00.510 19:27:47 -- host/failover.sh@99 -- # grep -q NVMe0 00:21:00.510 19:27:47 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:00.769 19:27:47 -- host/failover.sh@101 -- # sleep 3 00:21:04.112 19:27:50 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:04.112 19:27:50 -- host/failover.sh@103 -- # grep -q NVMe0 00:21:04.112 19:27:50 -- host/failover.sh@108 -- # killprocess 3089048 00:21:04.112 19:27:50 -- common/autotest_common.sh@936 -- # '[' -z 3089048 ']' 00:21:04.112 19:27:50 -- common/autotest_common.sh@940 -- # kill -0 3089048 00:21:04.112 19:27:50 -- common/autotest_common.sh@941 -- # uname 00:21:04.112 19:27:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.112 19:27:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3089048 00:21:04.112 19:27:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:04.112 19:27:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:04.112 19:27:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3089048' 00:21:04.112 killing process with pid 3089048 00:21:04.112 19:27:50 -- common/autotest_common.sh@955 -- # kill 3089048 00:21:04.112 19:27:50 -- common/autotest_common.sh@960 -- # wait 3089048 00:21:04.370 19:27:51 -- host/failover.sh@110 -- # sync 00:21:04.370 19:27:51 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:04.370 19:27:51 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:21:04.370 19:27:51 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:04.370 19:27:51 -- host/failover.sh@116 -- # nvmftestfini 00:21:04.370 19:27:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:04.370 19:27:51 -- nvmf/common.sh@117 -- # sync 00:21:04.370 19:27:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:04.370 19:27:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:04.370 19:27:51 -- nvmf/common.sh@120 -- # set +e 00:21:04.371 19:27:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:04.629 19:27:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:04.629 rmmod nvme_rdma 00:21:04.629 rmmod nvme_fabrics 00:21:04.629 19:27:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:04.629 19:27:51 -- nvmf/common.sh@124 -- # set -e 00:21:04.629 19:27:51 -- nvmf/common.sh@125 -- # return 0 00:21:04.629 19:27:51 -- nvmf/common.sh@478 -- # '[' -n 3086618 ']' 00:21:04.629 19:27:51 -- nvmf/common.sh@479 -- # killprocess 3086618 00:21:04.629 19:27:51 -- common/autotest_common.sh@936 -- # '[' -z 3086618 ']' 00:21:04.629 19:27:51 -- common/autotest_common.sh@940 -- # kill -0 3086618 00:21:04.629 19:27:51 -- common/autotest_common.sh@941 -- # uname 00:21:04.629 19:27:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.629 19:27:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3086618 00:21:04.629 19:27:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:04.629 19:27:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:04.629 19:27:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3086618' 00:21:04.629 killing process with pid 3086618 00:21:04.629 19:27:51 -- common/autotest_common.sh@955 -- # kill 3086618 00:21:04.629 19:27:51 -- common/autotest_common.sh@960 -- # wait 3086618 00:21:04.629 [2024-04-24 19:27:51.552043] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:04.888 19:27:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:04.888 19:27:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:04.888 00:21:04.888 real 0m36.791s 00:21:04.888 user 2m4.279s 00:21:04.888 sys 0m7.131s 00:21:04.888 19:27:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:04.888 19:27:51 -- common/autotest_common.sh@10 -- # set +x 00:21:04.888 ************************************ 00:21:04.888 END TEST nvmf_failover 00:21:04.888 ************************************ 00:21:04.888 19:27:51 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:21:04.888 19:27:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:04.888 19:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:04.888 19:27:51 -- common/autotest_common.sh@10 -- # set +x 00:21:05.147 ************************************ 00:21:05.147 START TEST nvmf_discovery 00:21:05.147 ************************************ 00:21:05.147 19:27:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:21:05.147 * Looking for test storage... 00:21:05.147 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:05.147 19:27:52 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:05.147 19:27:52 -- nvmf/common.sh@7 -- # uname -s 00:21:05.147 19:27:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:05.147 19:27:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:05.147 19:27:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:05.147 19:27:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:05.147 19:27:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:05.147 19:27:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:05.147 19:27:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:05.147 19:27:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:05.147 19:27:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:05.147 19:27:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:05.147 19:27:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:21:05.147 19:27:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:21:05.147 19:27:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:05.147 19:27:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:05.147 19:27:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:05.147 19:27:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:05.147 19:27:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:05.147 19:27:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:05.147 19:27:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:05.147 19:27:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:05.147 19:27:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.147 19:27:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.147 19:27:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.147 19:27:52 -- paths/export.sh@5 -- # export PATH 00:21:05.147 19:27:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.147 19:27:52 -- nvmf/common.sh@47 -- # : 0 00:21:05.147 19:27:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:05.147 19:27:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:05.147 19:27:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:05.147 19:27:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:05.147 19:27:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:05.147 19:27:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:05.147 19:27:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:05.147 19:27:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:05.147 19:27:52 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:21:05.147 19:27:52 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:21:05.147 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:21:05.147 19:27:52 -- host/discovery.sh@13 -- # exit 0 00:21:05.147 00:21:05.147 real 0m0.131s 00:21:05.147 user 0m0.053s 00:21:05.147 sys 0m0.089s 00:21:05.147 19:27:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:05.147 19:27:52 -- common/autotest_common.sh@10 -- # set +x 00:21:05.147 ************************************ 00:21:05.147 END TEST nvmf_discovery 00:21:05.147 ************************************ 00:21:05.406 19:27:52 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:21:05.406 19:27:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:05.406 19:27:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:05.406 19:27:52 -- common/autotest_common.sh@10 -- # set +x 00:21:05.406 ************************************ 00:21:05.406 START TEST nvmf_discovery_remove_ifc 00:21:05.406 ************************************ 00:21:05.406 19:27:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:21:05.406 * Looking for test storage... 00:21:05.406 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:05.406 19:27:52 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:05.406 19:27:52 -- nvmf/common.sh@7 -- # uname -s 00:21:05.406 19:27:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:05.406 19:27:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:05.406 19:27:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:05.406 19:27:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:05.406 19:27:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:05.406 19:27:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:05.406 19:27:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:05.406 19:27:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:05.406 19:27:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:05.406 19:27:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:05.406 19:27:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:21:05.406 19:27:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:21:05.406 19:27:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:05.406 19:27:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:05.406 19:27:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:05.406 19:27:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:05.406 19:27:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:05.406 19:27:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:05.406 19:27:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:05.406 19:27:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:05.406 19:27:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.406 19:27:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.406 19:27:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.406 19:27:52 -- paths/export.sh@5 -- # export PATH 00:21:05.406 19:27:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.406 19:27:52 -- nvmf/common.sh@47 -- # : 0 00:21:05.406 19:27:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:05.406 19:27:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:05.406 19:27:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:05.406 19:27:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:05.406 19:27:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:05.406 19:27:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:05.406 19:27:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:05.406 19:27:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:05.665 19:27:52 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:21:05.665 19:27:52 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:21:05.665 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:21:05.665 19:27:52 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:21:05.665 00:21:05.665 real 0m0.138s 00:21:05.665 user 0m0.062s 00:21:05.665 sys 0m0.087s 00:21:05.665 19:27:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:05.665 19:27:52 -- common/autotest_common.sh@10 -- # set +x 00:21:05.665 ************************************ 00:21:05.665 END TEST nvmf_discovery_remove_ifc 00:21:05.665 ************************************ 00:21:05.665 19:27:52 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:21:05.665 19:27:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:05.665 19:27:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:05.665 19:27:52 -- common/autotest_common.sh@10 -- # set +x 00:21:05.665 ************************************ 00:21:05.665 START TEST nvmf_identify_kernel_target 00:21:05.665 ************************************ 00:21:05.665 19:27:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:21:05.926 * Looking for test storage... 00:21:05.926 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:05.926 19:27:52 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:05.926 19:27:52 -- nvmf/common.sh@7 -- # uname -s 00:21:05.926 19:27:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:05.926 19:27:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:05.926 19:27:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:05.926 19:27:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:05.926 19:27:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:05.926 19:27:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:05.926 19:27:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:05.926 19:27:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:05.926 19:27:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:05.926 19:27:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:05.926 19:27:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:21:05.926 19:27:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:21:05.926 19:27:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:05.926 19:27:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:05.926 19:27:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:05.926 19:27:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:05.926 19:27:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:05.926 19:27:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:05.926 19:27:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:05.926 19:27:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:05.926 19:27:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.926 19:27:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.926 19:27:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.926 19:27:52 -- paths/export.sh@5 -- # export PATH 00:21:05.926 19:27:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.926 19:27:52 -- nvmf/common.sh@47 -- # : 0 00:21:05.926 19:27:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:05.926 19:27:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:05.926 19:27:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:05.926 19:27:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:05.926 19:27:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:05.926 19:27:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:05.926 19:27:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:05.926 19:27:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:05.926 19:27:52 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:21:05.926 19:27:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:05.926 19:27:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:05.926 19:27:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:05.926 19:27:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:05.926 19:27:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:05.926 19:27:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:05.926 19:27:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:05.926 19:27:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:05.926 19:27:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:05.926 19:27:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:05.926 19:27:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:05.926 19:27:52 -- common/autotest_common.sh@10 -- # set +x 00:21:12.496 19:27:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:12.496 19:27:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:12.496 19:27:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:12.496 19:27:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:12.496 19:27:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:12.496 19:27:58 -- nvmf/common.sh@295 -- # net_devs=() 00:21:12.496 19:27:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@296 -- # e810=() 00:21:12.496 19:27:58 -- nvmf/common.sh@296 -- # local -ga e810 00:21:12.496 19:27:58 -- nvmf/common.sh@297 -- # x722=() 00:21:12.496 19:27:58 -- nvmf/common.sh@297 -- # local -ga x722 00:21:12.496 19:27:58 -- nvmf/common.sh@298 -- # mlx=() 00:21:12.496 19:27:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:12.496 19:27:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:12.496 19:27:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:12.496 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:12.496 19:27:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:12.496 19:27:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:12.496 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:12.496 19:27:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:12.496 19:27:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.496 19:27:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.496 19:27:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:12.496 Found net devices under 0000:18:00.0: mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.496 19:27:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.496 19:27:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:12.496 Found net devices under 0000:18:00.1: mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.496 19:27:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:12.496 19:27:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:12.496 19:27:58 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:12.496 19:27:58 -- nvmf/common.sh@58 -- # uname 00:21:12.496 19:27:58 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:12.496 19:27:58 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:12.496 19:27:58 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:12.496 19:27:58 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:12.496 19:27:58 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:12.496 19:27:58 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:12.496 19:27:58 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:12.496 19:27:58 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:12.496 19:27:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:12.496 19:27:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:12.496 19:27:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:12.496 19:27:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:12.496 19:27:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:12.496 19:27:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@105 -- # continue 2 00:21:12.496 19:27:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@105 -- # continue 2 00:21:12.496 19:27:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:12.496 19:27:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:12.496 19:27:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:12.496 19:27:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:12.496 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:12.496 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:21:12.496 altname enp24s0f0np0 00:21:12.496 altname ens785f0np0 00:21:12.496 inet 192.168.100.8/24 scope global mlx_0_0 00:21:12.496 valid_lft forever preferred_lft forever 00:21:12.496 19:27:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:12.496 19:27:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:12.496 19:27:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:12.496 19:27:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:12.496 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:12.496 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:21:12.496 altname enp24s0f1np1 00:21:12.496 altname ens785f1np1 00:21:12.496 inet 192.168.100.9/24 scope global mlx_0_1 00:21:12.496 valid_lft forever preferred_lft forever 00:21:12.496 19:27:58 -- nvmf/common.sh@411 -- # return 0 00:21:12.496 19:27:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:12.496 19:27:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:12.496 19:27:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:12.496 19:27:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:12.496 19:27:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:12.496 19:27:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:12.496 19:27:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:12.496 19:27:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:12.496 19:27:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@105 -- # continue 2 00:21:12.496 19:27:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:12.496 19:27:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@105 -- # continue 2 00:21:12.496 19:27:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:12.496 19:27:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:12.496 19:27:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:12.496 19:27:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:12.496 19:27:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:12.496 19:27:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:12.496 192.168.100.9' 00:21:12.496 19:27:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:12.496 192.168.100.9' 00:21:12.496 19:27:58 -- nvmf/common.sh@446 -- # head -n 1 00:21:12.496 19:27:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:12.496 19:27:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:12.496 192.168.100.9' 00:21:12.496 19:27:58 -- nvmf/common.sh@447 -- # tail -n +2 00:21:12.496 19:27:58 -- nvmf/common.sh@447 -- # head -n 1 00:21:12.496 19:27:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:12.496 19:27:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:12.496 19:27:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:12.496 19:27:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:12.496 19:27:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:12.496 19:27:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:12.496 19:27:58 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:21:12.496 19:27:58 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:21:12.496 19:27:58 -- nvmf/common.sh@717 -- # local ip 00:21:12.496 19:27:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:12.496 19:27:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:12.496 19:27:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:12.496 19:27:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:12.496 19:27:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:12.496 19:27:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:12.496 19:27:58 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:21:12.496 19:27:58 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:21:12.496 19:27:58 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:21:12.496 19:27:58 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:21:12.496 19:27:58 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:12.496 19:27:58 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:12.496 19:27:58 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:21:12.496 19:27:58 -- nvmf/common.sh@628 -- # local block nvme 00:21:12.496 19:27:58 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@631 -- # modprobe nvmet 00:21:12.496 19:27:58 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:21:12.496 19:27:58 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:21:14.395 Waiting for block devices as requested 00:21:14.395 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:21:14.395 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:14.653 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:14.653 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:14.653 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:14.653 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:14.912 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:14.912 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:14.912 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:15.170 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:15.170 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:15.170 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:15.170 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:15.429 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:15.429 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:15.429 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:15.687 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:15.687 19:28:02 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:21:15.687 19:28:02 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:21:15.687 19:28:02 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:21:15.687 19:28:02 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:21:15.687 19:28:02 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:21:15.687 19:28:02 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:21:15.687 19:28:02 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:21:15.687 19:28:02 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:21:15.687 19:28:02 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:21:15.687 No valid GPT data, bailing 00:21:15.687 19:28:02 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:21:15.687 19:28:02 -- scripts/common.sh@391 -- # pt= 00:21:15.687 19:28:02 -- scripts/common.sh@392 -- # return 1 00:21:15.687 19:28:02 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:21:15.687 19:28:02 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:21:15.687 19:28:02 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:15.687 19:28:02 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:15.687 19:28:02 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:21:15.946 19:28:02 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:21:15.946 19:28:02 -- nvmf/common.sh@656 -- # echo 1 00:21:15.946 19:28:02 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:21:15.946 19:28:02 -- nvmf/common.sh@658 -- # echo 1 00:21:15.946 19:28:02 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:21:15.946 19:28:02 -- nvmf/common.sh@661 -- # echo rdma 00:21:15.946 19:28:02 -- nvmf/common.sh@662 -- # echo 4420 00:21:15.946 19:28:02 -- nvmf/common.sh@663 -- # echo ipv4 00:21:15.946 19:28:02 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:21:15.946 19:28:02 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:21:15.946 00:21:15.946 Discovery Log Number of Records 2, Generation counter 2 00:21:15.946 =====Discovery Log Entry 0====== 00:21:15.946 trtype: rdma 00:21:15.946 adrfam: ipv4 00:21:15.946 subtype: current discovery subsystem 00:21:15.946 treq: not specified, sq flow control disable supported 00:21:15.946 portid: 1 00:21:15.946 trsvcid: 4420 00:21:15.946 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:21:15.946 traddr: 192.168.100.8 00:21:15.946 eflags: none 00:21:15.946 rdma_prtype: not specified 00:21:15.946 rdma_qptype: connected 00:21:15.946 rdma_cms: rdma-cm 00:21:15.946 rdma_pkey: 0x0000 00:21:15.946 =====Discovery Log Entry 1====== 00:21:15.946 trtype: rdma 00:21:15.946 adrfam: ipv4 00:21:15.946 subtype: nvme subsystem 00:21:15.946 treq: not specified, sq flow control disable supported 00:21:15.946 portid: 1 00:21:15.946 trsvcid: 4420 00:21:15.946 subnqn: nqn.2016-06.io.spdk:testnqn 00:21:15.946 traddr: 192.168.100.8 00:21:15.946 eflags: none 00:21:15.946 rdma_prtype: not specified 00:21:15.946 rdma_qptype: connected 00:21:15.946 rdma_cms: rdma-cm 00:21:15.946 rdma_pkey: 0x0000 00:21:15.946 19:28:02 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:21:15.946 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:21:15.946 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.205 ===================================================== 00:21:16.205 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:21:16.205 ===================================================== 00:21:16.205 Controller Capabilities/Features 00:21:16.205 ================================ 00:21:16.205 Vendor ID: 0000 00:21:16.205 Subsystem Vendor ID: 0000 00:21:16.205 Serial Number: 87b604a7eac05dd47113 00:21:16.205 Model Number: Linux 00:21:16.205 Firmware Version: 6.7.0-68 00:21:16.205 Recommended Arb Burst: 0 00:21:16.205 IEEE OUI Identifier: 00 00 00 00:21:16.205 Multi-path I/O 00:21:16.205 May have multiple subsystem ports: No 00:21:16.205 May have multiple controllers: No 00:21:16.205 Associated with SR-IOV VF: No 00:21:16.205 Max Data Transfer Size: Unlimited 00:21:16.205 Max Number of Namespaces: 0 00:21:16.205 Max Number of I/O Queues: 1024 00:21:16.205 NVMe Specification Version (VS): 1.3 00:21:16.205 NVMe Specification Version (Identify): 1.3 00:21:16.205 Maximum Queue Entries: 128 00:21:16.205 Contiguous Queues Required: No 00:21:16.205 Arbitration Mechanisms Supported 00:21:16.205 Weighted Round Robin: Not Supported 00:21:16.205 Vendor Specific: Not Supported 00:21:16.205 Reset Timeout: 7500 ms 00:21:16.205 Doorbell Stride: 4 bytes 00:21:16.205 NVM Subsystem Reset: Not Supported 00:21:16.205 Command Sets Supported 00:21:16.205 NVM Command Set: Supported 00:21:16.205 Boot Partition: Not Supported 00:21:16.205 Memory Page Size Minimum: 4096 bytes 00:21:16.205 Memory Page Size Maximum: 4096 bytes 00:21:16.205 Persistent Memory Region: Not Supported 00:21:16.205 Optional Asynchronous Events Supported 00:21:16.205 Namespace Attribute Notices: Not Supported 00:21:16.205 Firmware Activation Notices: Not Supported 00:21:16.205 ANA Change Notices: Not Supported 00:21:16.205 PLE Aggregate Log Change Notices: Not Supported 00:21:16.205 LBA Status Info Alert Notices: Not Supported 00:21:16.205 EGE Aggregate Log Change Notices: Not Supported 00:21:16.205 Normal NVM Subsystem Shutdown event: Not Supported 00:21:16.205 Zone Descriptor Change Notices: Not Supported 00:21:16.205 Discovery Log Change Notices: Supported 00:21:16.205 Controller Attributes 00:21:16.205 128-bit Host Identifier: Not Supported 00:21:16.206 Non-Operational Permissive Mode: Not Supported 00:21:16.206 NVM Sets: Not Supported 00:21:16.206 Read Recovery Levels: Not Supported 00:21:16.206 Endurance Groups: Not Supported 00:21:16.206 Predictable Latency Mode: Not Supported 00:21:16.206 Traffic Based Keep ALive: Not Supported 00:21:16.206 Namespace Granularity: Not Supported 00:21:16.206 SQ Associations: Not Supported 00:21:16.206 UUID List: Not Supported 00:21:16.206 Multi-Domain Subsystem: Not Supported 00:21:16.206 Fixed Capacity Management: Not Supported 00:21:16.206 Variable Capacity Management: Not Supported 00:21:16.206 Delete Endurance Group: Not Supported 00:21:16.206 Delete NVM Set: Not Supported 00:21:16.206 Extended LBA Formats Supported: Not Supported 00:21:16.206 Flexible Data Placement Supported: Not Supported 00:21:16.206 00:21:16.206 Controller Memory Buffer Support 00:21:16.206 ================================ 00:21:16.206 Supported: No 00:21:16.206 00:21:16.206 Persistent Memory Region Support 00:21:16.206 ================================ 00:21:16.206 Supported: No 00:21:16.206 00:21:16.206 Admin Command Set Attributes 00:21:16.206 ============================ 00:21:16.206 Security Send/Receive: Not Supported 00:21:16.206 Format NVM: Not Supported 00:21:16.206 Firmware Activate/Download: Not Supported 00:21:16.206 Namespace Management: Not Supported 00:21:16.206 Device Self-Test: Not Supported 00:21:16.206 Directives: Not Supported 00:21:16.206 NVMe-MI: Not Supported 00:21:16.206 Virtualization Management: Not Supported 00:21:16.206 Doorbell Buffer Config: Not Supported 00:21:16.206 Get LBA Status Capability: Not Supported 00:21:16.206 Command & Feature Lockdown Capability: Not Supported 00:21:16.206 Abort Command Limit: 1 00:21:16.206 Async Event Request Limit: 1 00:21:16.206 Number of Firmware Slots: N/A 00:21:16.206 Firmware Slot 1 Read-Only: N/A 00:21:16.206 Firmware Activation Without Reset: N/A 00:21:16.206 Multiple Update Detection Support: N/A 00:21:16.206 Firmware Update Granularity: No Information Provided 00:21:16.206 Per-Namespace SMART Log: No 00:21:16.206 Asymmetric Namespace Access Log Page: Not Supported 00:21:16.206 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:21:16.206 Command Effects Log Page: Not Supported 00:21:16.206 Get Log Page Extended Data: Supported 00:21:16.206 Telemetry Log Pages: Not Supported 00:21:16.206 Persistent Event Log Pages: Not Supported 00:21:16.206 Supported Log Pages Log Page: May Support 00:21:16.206 Commands Supported & Effects Log Page: Not Supported 00:21:16.206 Feature Identifiers & Effects Log Page:May Support 00:21:16.206 NVMe-MI Commands & Effects Log Page: May Support 00:21:16.206 Data Area 4 for Telemetry Log: Not Supported 00:21:16.206 Error Log Page Entries Supported: 1 00:21:16.206 Keep Alive: Not Supported 00:21:16.206 00:21:16.206 NVM Command Set Attributes 00:21:16.206 ========================== 00:21:16.206 Submission Queue Entry Size 00:21:16.206 Max: 1 00:21:16.206 Min: 1 00:21:16.206 Completion Queue Entry Size 00:21:16.206 Max: 1 00:21:16.206 Min: 1 00:21:16.206 Number of Namespaces: 0 00:21:16.206 Compare Command: Not Supported 00:21:16.206 Write Uncorrectable Command: Not Supported 00:21:16.206 Dataset Management Command: Not Supported 00:21:16.206 Write Zeroes Command: Not Supported 00:21:16.206 Set Features Save Field: Not Supported 00:21:16.206 Reservations: Not Supported 00:21:16.206 Timestamp: Not Supported 00:21:16.206 Copy: Not Supported 00:21:16.206 Volatile Write Cache: Not Present 00:21:16.206 Atomic Write Unit (Normal): 1 00:21:16.206 Atomic Write Unit (PFail): 1 00:21:16.206 Atomic Compare & Write Unit: 1 00:21:16.206 Fused Compare & Write: Not Supported 00:21:16.206 Scatter-Gather List 00:21:16.206 SGL Command Set: Supported 00:21:16.206 SGL Keyed: Supported 00:21:16.206 SGL Bit Bucket Descriptor: Not Supported 00:21:16.206 SGL Metadata Pointer: Not Supported 00:21:16.206 Oversized SGL: Not Supported 00:21:16.206 SGL Metadata Address: Not Supported 00:21:16.206 SGL Offset: Supported 00:21:16.206 Transport SGL Data Block: Not Supported 00:21:16.206 Replay Protected Memory Block: Not Supported 00:21:16.206 00:21:16.206 Firmware Slot Information 00:21:16.206 ========================= 00:21:16.206 Active slot: 0 00:21:16.206 00:21:16.206 00:21:16.206 Error Log 00:21:16.206 ========= 00:21:16.206 00:21:16.206 Active Namespaces 00:21:16.206 ================= 00:21:16.206 Discovery Log Page 00:21:16.206 ================== 00:21:16.206 Generation Counter: 2 00:21:16.206 Number of Records: 2 00:21:16.206 Record Format: 0 00:21:16.206 00:21:16.206 Discovery Log Entry 0 00:21:16.206 ---------------------- 00:21:16.206 Transport Type: 1 (RDMA) 00:21:16.206 Address Family: 1 (IPv4) 00:21:16.206 Subsystem Type: 3 (Current Discovery Subsystem) 00:21:16.206 Entry Flags: 00:21:16.206 Duplicate Returned Information: 0 00:21:16.206 Explicit Persistent Connection Support for Discovery: 0 00:21:16.206 Transport Requirements: 00:21:16.206 Secure Channel: Not Specified 00:21:16.206 Port ID: 1 (0x0001) 00:21:16.206 Controller ID: 65535 (0xffff) 00:21:16.206 Admin Max SQ Size: 32 00:21:16.206 Transport Service Identifier: 4420 00:21:16.206 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:21:16.206 Transport Address: 192.168.100.8 00:21:16.206 Transport Specific Address Subtype - RDMA 00:21:16.206 RDMA QP Service Type: 1 (Reliable Connected) 00:21:16.206 RDMA Provider Type: 1 (No provider specified) 00:21:16.206 RDMA CM Service: 1 (RDMA_CM) 00:21:16.206 Discovery Log Entry 1 00:21:16.206 ---------------------- 00:21:16.206 Transport Type: 1 (RDMA) 00:21:16.206 Address Family: 1 (IPv4) 00:21:16.206 Subsystem Type: 2 (NVM Subsystem) 00:21:16.206 Entry Flags: 00:21:16.206 Duplicate Returned Information: 0 00:21:16.206 Explicit Persistent Connection Support for Discovery: 0 00:21:16.206 Transport Requirements: 00:21:16.206 Secure Channel: Not Specified 00:21:16.206 Port ID: 1 (0x0001) 00:21:16.206 Controller ID: 65535 (0xffff) 00:21:16.206 Admin Max SQ Size: 32 00:21:16.206 Transport Service Identifier: 4420 00:21:16.206 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:21:16.206 Transport Address: 192.168.100.8 00:21:16.206 Transport Specific Address Subtype - RDMA 00:21:16.206 RDMA QP Service Type: 1 (Reliable Connected) 00:21:16.206 RDMA Provider Type: 1 (No provider specified) 00:21:16.206 RDMA CM Service: 1 (RDMA_CM) 00:21:16.206 19:28:03 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:21:16.206 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.206 get_feature(0x01) failed 00:21:16.206 get_feature(0x02) failed 00:21:16.206 get_feature(0x04) failed 00:21:16.206 ===================================================== 00:21:16.206 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:21:16.206 ===================================================== 00:21:16.206 Controller Capabilities/Features 00:21:16.206 ================================ 00:21:16.206 Vendor ID: 0000 00:21:16.206 Subsystem Vendor ID: 0000 00:21:16.206 Serial Number: eb7dcdf073463b4aaf21 00:21:16.206 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:21:16.206 Firmware Version: 6.7.0-68 00:21:16.206 Recommended Arb Burst: 6 00:21:16.206 IEEE OUI Identifier: 00 00 00 00:21:16.206 Multi-path I/O 00:21:16.206 May have multiple subsystem ports: Yes 00:21:16.206 May have multiple controllers: Yes 00:21:16.206 Associated with SR-IOV VF: No 00:21:16.206 Max Data Transfer Size: 1048576 00:21:16.206 Max Number of Namespaces: 1024 00:21:16.206 Max Number of I/O Queues: 128 00:21:16.206 NVMe Specification Version (VS): 1.3 00:21:16.206 NVMe Specification Version (Identify): 1.3 00:21:16.206 Maximum Queue Entries: 128 00:21:16.206 Contiguous Queues Required: No 00:21:16.206 Arbitration Mechanisms Supported 00:21:16.206 Weighted Round Robin: Not Supported 00:21:16.206 Vendor Specific: Not Supported 00:21:16.206 Reset Timeout: 7500 ms 00:21:16.206 Doorbell Stride: 4 bytes 00:21:16.206 NVM Subsystem Reset: Not Supported 00:21:16.206 Command Sets Supported 00:21:16.206 NVM Command Set: Supported 00:21:16.206 Boot Partition: Not Supported 00:21:16.206 Memory Page Size Minimum: 4096 bytes 00:21:16.206 Memory Page Size Maximum: 4096 bytes 00:21:16.206 Persistent Memory Region: Not Supported 00:21:16.206 Optional Asynchronous Events Supported 00:21:16.206 Namespace Attribute Notices: Supported 00:21:16.206 Firmware Activation Notices: Not Supported 00:21:16.206 ANA Change Notices: Supported 00:21:16.206 PLE Aggregate Log Change Notices: Not Supported 00:21:16.206 LBA Status Info Alert Notices: Not Supported 00:21:16.206 EGE Aggregate Log Change Notices: Not Supported 00:21:16.206 Normal NVM Subsystem Shutdown event: Not Supported 00:21:16.206 Zone Descriptor Change Notices: Not Supported 00:21:16.206 Discovery Log Change Notices: Not Supported 00:21:16.206 Controller Attributes 00:21:16.206 128-bit Host Identifier: Supported 00:21:16.206 Non-Operational Permissive Mode: Not Supported 00:21:16.206 NVM Sets: Not Supported 00:21:16.206 Read Recovery Levels: Not Supported 00:21:16.206 Endurance Groups: Not Supported 00:21:16.206 Predictable Latency Mode: Not Supported 00:21:16.206 Traffic Based Keep ALive: Supported 00:21:16.206 Namespace Granularity: Not Supported 00:21:16.206 SQ Associations: Not Supported 00:21:16.206 UUID List: Not Supported 00:21:16.206 Multi-Domain Subsystem: Not Supported 00:21:16.206 Fixed Capacity Management: Not Supported 00:21:16.206 Variable Capacity Management: Not Supported 00:21:16.207 Delete Endurance Group: Not Supported 00:21:16.207 Delete NVM Set: Not Supported 00:21:16.207 Extended LBA Formats Supported: Not Supported 00:21:16.207 Flexible Data Placement Supported: Not Supported 00:21:16.207 00:21:16.207 Controller Memory Buffer Support 00:21:16.207 ================================ 00:21:16.207 Supported: No 00:21:16.207 00:21:16.207 Persistent Memory Region Support 00:21:16.207 ================================ 00:21:16.207 Supported: No 00:21:16.207 00:21:16.207 Admin Command Set Attributes 00:21:16.207 ============================ 00:21:16.207 Security Send/Receive: Not Supported 00:21:16.207 Format NVM: Not Supported 00:21:16.207 Firmware Activate/Download: Not Supported 00:21:16.207 Namespace Management: Not Supported 00:21:16.207 Device Self-Test: Not Supported 00:21:16.207 Directives: Not Supported 00:21:16.207 NVMe-MI: Not Supported 00:21:16.207 Virtualization Management: Not Supported 00:21:16.207 Doorbell Buffer Config: Not Supported 00:21:16.207 Get LBA Status Capability: Not Supported 00:21:16.207 Command & Feature Lockdown Capability: Not Supported 00:21:16.207 Abort Command Limit: 4 00:21:16.207 Async Event Request Limit: 4 00:21:16.207 Number of Firmware Slots: N/A 00:21:16.207 Firmware Slot 1 Read-Only: N/A 00:21:16.207 Firmware Activation Without Reset: N/A 00:21:16.207 Multiple Update Detection Support: N/A 00:21:16.207 Firmware Update Granularity: No Information Provided 00:21:16.207 Per-Namespace SMART Log: Yes 00:21:16.207 Asymmetric Namespace Access Log Page: Supported 00:21:16.207 ANA Transition Time : 10 sec 00:21:16.207 00:21:16.207 Asymmetric Namespace Access Capabilities 00:21:16.207 ANA Optimized State : Supported 00:21:16.207 ANA Non-Optimized State : Supported 00:21:16.207 ANA Inaccessible State : Supported 00:21:16.207 ANA Persistent Loss State : Supported 00:21:16.207 ANA Change State : Supported 00:21:16.207 ANAGRPID is not changed : No 00:21:16.207 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:21:16.207 00:21:16.207 ANA Group Identifier Maximum : 128 00:21:16.207 Number of ANA Group Identifiers : 128 00:21:16.207 Max Number of Allowed Namespaces : 1024 00:21:16.207 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:21:16.207 Command Effects Log Page: Supported 00:21:16.207 Get Log Page Extended Data: Supported 00:21:16.207 Telemetry Log Pages: Not Supported 00:21:16.207 Persistent Event Log Pages: Not Supported 00:21:16.207 Supported Log Pages Log Page: May Support 00:21:16.207 Commands Supported & Effects Log Page: Not Supported 00:21:16.207 Feature Identifiers & Effects Log Page:May Support 00:21:16.207 NVMe-MI Commands & Effects Log Page: May Support 00:21:16.207 Data Area 4 for Telemetry Log: Not Supported 00:21:16.207 Error Log Page Entries Supported: 128 00:21:16.207 Keep Alive: Supported 00:21:16.207 Keep Alive Granularity: 1000 ms 00:21:16.207 00:21:16.207 NVM Command Set Attributes 00:21:16.207 ========================== 00:21:16.207 Submission Queue Entry Size 00:21:16.207 Max: 64 00:21:16.207 Min: 64 00:21:16.207 Completion Queue Entry Size 00:21:16.207 Max: 16 00:21:16.207 Min: 16 00:21:16.207 Number of Namespaces: 1024 00:21:16.207 Compare Command: Not Supported 00:21:16.207 Write Uncorrectable Command: Not Supported 00:21:16.207 Dataset Management Command: Supported 00:21:16.207 Write Zeroes Command: Supported 00:21:16.207 Set Features Save Field: Not Supported 00:21:16.207 Reservations: Not Supported 00:21:16.207 Timestamp: Not Supported 00:21:16.207 Copy: Not Supported 00:21:16.207 Volatile Write Cache: Present 00:21:16.207 Atomic Write Unit (Normal): 1 00:21:16.207 Atomic Write Unit (PFail): 1 00:21:16.207 Atomic Compare & Write Unit: 1 00:21:16.207 Fused Compare & Write: Not Supported 00:21:16.207 Scatter-Gather List 00:21:16.207 SGL Command Set: Supported 00:21:16.207 SGL Keyed: Supported 00:21:16.207 SGL Bit Bucket Descriptor: Not Supported 00:21:16.207 SGL Metadata Pointer: Not Supported 00:21:16.207 Oversized SGL: Not Supported 00:21:16.207 SGL Metadata Address: Not Supported 00:21:16.207 SGL Offset: Supported 00:21:16.207 Transport SGL Data Block: Not Supported 00:21:16.207 Replay Protected Memory Block: Not Supported 00:21:16.207 00:21:16.207 Firmware Slot Information 00:21:16.207 ========================= 00:21:16.207 Active slot: 0 00:21:16.207 00:21:16.207 Asymmetric Namespace Access 00:21:16.207 =========================== 00:21:16.207 Change Count : 0 00:21:16.207 Number of ANA Group Descriptors : 1 00:21:16.207 ANA Group Descriptor : 0 00:21:16.207 ANA Group ID : 1 00:21:16.207 Number of NSID Values : 1 00:21:16.207 Change Count : 0 00:21:16.207 ANA State : 1 00:21:16.207 Namespace Identifier : 1 00:21:16.207 00:21:16.207 Commands Supported and Effects 00:21:16.207 ============================== 00:21:16.207 Admin Commands 00:21:16.207 -------------- 00:21:16.207 Get Log Page (02h): Supported 00:21:16.207 Identify (06h): Supported 00:21:16.207 Abort (08h): Supported 00:21:16.207 Set Features (09h): Supported 00:21:16.207 Get Features (0Ah): Supported 00:21:16.207 Asynchronous Event Request (0Ch): Supported 00:21:16.207 Keep Alive (18h): Supported 00:21:16.207 I/O Commands 00:21:16.207 ------------ 00:21:16.207 Flush (00h): Supported 00:21:16.207 Write (01h): Supported LBA-Change 00:21:16.207 Read (02h): Supported 00:21:16.207 Write Zeroes (08h): Supported LBA-Change 00:21:16.207 Dataset Management (09h): Supported 00:21:16.207 00:21:16.207 Error Log 00:21:16.207 ========= 00:21:16.207 Entry: 0 00:21:16.207 Error Count: 0x3 00:21:16.207 Submission Queue Id: 0x0 00:21:16.207 Command Id: 0x5 00:21:16.207 Phase Bit: 0 00:21:16.207 Status Code: 0x2 00:21:16.207 Status Code Type: 0x0 00:21:16.207 Do Not Retry: 1 00:21:16.207 Error Location: 0x28 00:21:16.207 LBA: 0x0 00:21:16.207 Namespace: 0x0 00:21:16.207 Vendor Log Page: 0x0 00:21:16.207 ----------- 00:21:16.207 Entry: 1 00:21:16.207 Error Count: 0x2 00:21:16.207 Submission Queue Id: 0x0 00:21:16.207 Command Id: 0x5 00:21:16.207 Phase Bit: 0 00:21:16.207 Status Code: 0x2 00:21:16.207 Status Code Type: 0x0 00:21:16.207 Do Not Retry: 1 00:21:16.207 Error Location: 0x28 00:21:16.207 LBA: 0x0 00:21:16.207 Namespace: 0x0 00:21:16.207 Vendor Log Page: 0x0 00:21:16.207 ----------- 00:21:16.207 Entry: 2 00:21:16.207 Error Count: 0x1 00:21:16.207 Submission Queue Id: 0x0 00:21:16.207 Command Id: 0x0 00:21:16.207 Phase Bit: 0 00:21:16.207 Status Code: 0x2 00:21:16.207 Status Code Type: 0x0 00:21:16.207 Do Not Retry: 1 00:21:16.207 Error Location: 0x28 00:21:16.207 LBA: 0x0 00:21:16.207 Namespace: 0x0 00:21:16.207 Vendor Log Page: 0x0 00:21:16.207 00:21:16.207 Number of Queues 00:21:16.207 ================ 00:21:16.207 Number of I/O Submission Queues: 128 00:21:16.207 Number of I/O Completion Queues: 128 00:21:16.207 00:21:16.207 ZNS Specific Controller Data 00:21:16.207 ============================ 00:21:16.207 Zone Append Size Limit: 0 00:21:16.207 00:21:16.207 00:21:16.207 Active Namespaces 00:21:16.207 ================= 00:21:16.207 get_feature(0x05) failed 00:21:16.207 Namespace ID:1 00:21:16.207 Command Set Identifier: NVM (00h) 00:21:16.207 Deallocate: Supported 00:21:16.207 Deallocated/Unwritten Error: Not Supported 00:21:16.207 Deallocated Read Value: Unknown 00:21:16.207 Deallocate in Write Zeroes: Not Supported 00:21:16.207 Deallocated Guard Field: 0xFFFF 00:21:16.207 Flush: Supported 00:21:16.207 Reservation: Not Supported 00:21:16.207 Namespace Sharing Capabilities: Multiple Controllers 00:21:16.207 Size (in LBAs): 3905075664 (1862GiB) 00:21:16.207 Capacity (in LBAs): 3905075664 (1862GiB) 00:21:16.207 Utilization (in LBAs): 3905075664 (1862GiB) 00:21:16.207 UUID: 0b973c0d-183a-4bdf-801c-bbaf4ae0e41d 00:21:16.207 Thin Provisioning: Not Supported 00:21:16.207 Per-NS Atomic Units: Yes 00:21:16.207 Atomic Boundary Size (Normal): 0 00:21:16.207 Atomic Boundary Size (PFail): 0 00:21:16.207 Atomic Boundary Offset: 0 00:21:16.207 NGUID/EUI64 Never Reused: No 00:21:16.207 ANA group ID: 1 00:21:16.207 Namespace Write Protected: No 00:21:16.207 Number of LBA Formats: 1 00:21:16.207 Current LBA Format: LBA Format #00 00:21:16.207 LBA Format #00: Data Size: 512 Metadata Size: 0 00:21:16.207 00:21:16.207 19:28:03 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:21:16.207 19:28:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:16.207 19:28:03 -- nvmf/common.sh@117 -- # sync 00:21:16.207 19:28:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:16.207 19:28:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:16.207 19:28:03 -- nvmf/common.sh@120 -- # set +e 00:21:16.207 19:28:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:16.207 19:28:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:16.207 rmmod nvme_rdma 00:21:16.207 rmmod nvme_fabrics 00:21:16.207 19:28:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:16.207 19:28:03 -- nvmf/common.sh@124 -- # set -e 00:21:16.207 19:28:03 -- nvmf/common.sh@125 -- # return 0 00:21:16.207 19:28:03 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:21:16.207 19:28:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:16.465 19:28:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:16.465 19:28:03 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:21:16.465 19:28:03 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:21:16.465 19:28:03 -- nvmf/common.sh@675 -- # echo 0 00:21:16.465 19:28:03 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:16.465 19:28:03 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:16.465 19:28:03 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:21:16.465 19:28:03 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:16.466 19:28:03 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:21:16.466 19:28:03 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:21:16.466 19:28:03 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:21:19.750 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:21:19.750 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:21:21.125 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:21:21.383 00:21:21.383 real 0m15.534s 00:21:21.383 user 0m4.060s 00:21:21.383 sys 0m8.835s 00:21:21.383 19:28:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:21.383 19:28:08 -- common/autotest_common.sh@10 -- # set +x 00:21:21.383 ************************************ 00:21:21.383 END TEST nvmf_identify_kernel_target 00:21:21.383 ************************************ 00:21:21.383 19:28:08 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:21:21.383 19:28:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:21.383 19:28:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:21.383 19:28:08 -- common/autotest_common.sh@10 -- # set +x 00:21:21.383 ************************************ 00:21:21.383 START TEST nvmf_auth 00:21:21.383 ************************************ 00:21:21.383 19:28:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:21:21.642 * Looking for test storage... 00:21:21.642 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:21.642 19:28:08 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:21.642 19:28:08 -- nvmf/common.sh@7 -- # uname -s 00:21:21.642 19:28:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:21.642 19:28:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:21.642 19:28:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:21.642 19:28:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:21.642 19:28:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:21.642 19:28:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:21.642 19:28:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:21.642 19:28:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:21.642 19:28:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:21.642 19:28:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:21.642 19:28:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:21:21.642 19:28:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:21:21.642 19:28:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:21.642 19:28:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:21.642 19:28:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:21.642 19:28:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:21.642 19:28:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:21.642 19:28:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:21.642 19:28:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:21.642 19:28:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:21.642 19:28:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.642 19:28:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.642 19:28:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.642 19:28:08 -- paths/export.sh@5 -- # export PATH 00:21:21.642 19:28:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.642 19:28:08 -- nvmf/common.sh@47 -- # : 0 00:21:21.642 19:28:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:21.642 19:28:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:21.642 19:28:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:21.642 19:28:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:21.642 19:28:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:21.642 19:28:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:21.642 19:28:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:21.642 19:28:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:21.642 19:28:08 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:21:21.642 19:28:08 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:21:21.642 19:28:08 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:21:21.642 19:28:08 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:21:21.642 19:28:08 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:21.642 19:28:08 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:21:21.642 19:28:08 -- host/auth.sh@21 -- # keys=() 00:21:21.642 19:28:08 -- host/auth.sh@77 -- # nvmftestinit 00:21:21.642 19:28:08 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:21.642 19:28:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:21.642 19:28:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:21.642 19:28:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:21.642 19:28:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:21.642 19:28:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:21.642 19:28:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:21.642 19:28:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:21.642 19:28:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:21.642 19:28:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:21.642 19:28:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:21.642 19:28:08 -- common/autotest_common.sh@10 -- # set +x 00:21:28.204 19:28:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:28.204 19:28:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:28.204 19:28:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:28.204 19:28:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:28.204 19:28:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:28.204 19:28:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:28.204 19:28:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:28.204 19:28:14 -- nvmf/common.sh@295 -- # net_devs=() 00:21:28.204 19:28:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:28.204 19:28:14 -- nvmf/common.sh@296 -- # e810=() 00:21:28.204 19:28:14 -- nvmf/common.sh@296 -- # local -ga e810 00:21:28.204 19:28:14 -- nvmf/common.sh@297 -- # x722=() 00:21:28.204 19:28:14 -- nvmf/common.sh@297 -- # local -ga x722 00:21:28.204 19:28:14 -- nvmf/common.sh@298 -- # mlx=() 00:21:28.205 19:28:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:28.205 19:28:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:28.205 19:28:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:28.205 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:28.205 19:28:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:28.205 19:28:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:28.205 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:28.205 19:28:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:28.205 19:28:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.205 19:28:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.205 19:28:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:28.205 Found net devices under 0000:18:00.0: mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.205 19:28:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.205 19:28:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:28.205 Found net devices under 0000:18:00.1: mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.205 19:28:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:28.205 19:28:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:28.205 19:28:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:28.205 19:28:14 -- nvmf/common.sh@58 -- # uname 00:21:28.205 19:28:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:28.205 19:28:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:28.205 19:28:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:28.205 19:28:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:28.205 19:28:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:28.205 19:28:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:28.205 19:28:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:28.205 19:28:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:28.205 19:28:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:28.205 19:28:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:28.205 19:28:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:28.205 19:28:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:28.205 19:28:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:28.205 19:28:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:28.205 19:28:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:28.205 19:28:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@105 -- # continue 2 00:21:28.205 19:28:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@105 -- # continue 2 00:21:28.205 19:28:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:28.205 19:28:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.205 19:28:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:28.205 19:28:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:28.205 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:28.205 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:21:28.205 altname enp24s0f0np0 00:21:28.205 altname ens785f0np0 00:21:28.205 inet 192.168.100.8/24 scope global mlx_0_0 00:21:28.205 valid_lft forever preferred_lft forever 00:21:28.205 19:28:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:28.205 19:28:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.205 19:28:14 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:28.205 19:28:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:28.205 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:28.205 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:21:28.205 altname enp24s0f1np1 00:21:28.205 altname ens785f1np1 00:21:28.205 inet 192.168.100.9/24 scope global mlx_0_1 00:21:28.205 valid_lft forever preferred_lft forever 00:21:28.205 19:28:14 -- nvmf/common.sh@411 -- # return 0 00:21:28.205 19:28:14 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:28.205 19:28:14 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:28.205 19:28:14 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:28.205 19:28:14 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:28.205 19:28:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:28.205 19:28:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:28.205 19:28:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:28.205 19:28:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:28.205 19:28:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:28.205 19:28:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@105 -- # continue 2 00:21:28.205 19:28:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.205 19:28:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:28.205 19:28:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@105 -- # continue 2 00:21:28.205 19:28:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:28.205 19:28:14 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.205 19:28:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:28.205 19:28:14 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.205 19:28:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.205 19:28:14 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:28.205 192.168.100.9' 00:21:28.205 19:28:14 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:28.205 192.168.100.9' 00:21:28.205 19:28:14 -- nvmf/common.sh@446 -- # head -n 1 00:21:28.205 19:28:14 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:28.205 19:28:14 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:28.205 192.168.100.9' 00:21:28.206 19:28:14 -- nvmf/common.sh@447 -- # tail -n +2 00:21:28.206 19:28:14 -- nvmf/common.sh@447 -- # head -n 1 00:21:28.206 19:28:14 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:28.206 19:28:14 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:28.206 19:28:14 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:28.206 19:28:14 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:28.206 19:28:14 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:28.206 19:28:14 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:28.206 19:28:14 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:21:28.206 19:28:14 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:28.206 19:28:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:28.206 19:28:14 -- common/autotest_common.sh@10 -- # set +x 00:21:28.206 19:28:14 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:21:28.206 19:28:14 -- nvmf/common.sh@470 -- # nvmfpid=3099055 00:21:28.206 19:28:14 -- nvmf/common.sh@471 -- # waitforlisten 3099055 00:21:28.206 19:28:14 -- common/autotest_common.sh@817 -- # '[' -z 3099055 ']' 00:21:28.206 19:28:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.206 19:28:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:28.206 19:28:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.206 19:28:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:28.206 19:28:14 -- common/autotest_common.sh@10 -- # set +x 00:21:28.206 19:28:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:28.206 19:28:15 -- common/autotest_common.sh@850 -- # return 0 00:21:28.206 19:28:15 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:28.206 19:28:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:28.206 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.464 19:28:15 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:28.464 19:28:15 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:21:28.464 19:28:15 -- host/auth.sh@81 -- # gen_key null 32 00:21:28.464 19:28:15 -- host/auth.sh@53 -- # local digest len file key 00:21:28.464 19:28:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:28.464 19:28:15 -- host/auth.sh@54 -- # local -A digests 00:21:28.464 19:28:15 -- host/auth.sh@56 -- # digest=null 00:21:28.464 19:28:15 -- host/auth.sh@56 -- # len=32 00:21:28.464 19:28:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:21:28.464 19:28:15 -- host/auth.sh@57 -- # key=2d418b36963005c8c472f2cdd9c61add 00:21:28.464 19:28:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:21:28.464 19:28:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.tN9 00:21:28.464 19:28:15 -- host/auth.sh@59 -- # format_dhchap_key 2d418b36963005c8c472f2cdd9c61add 0 00:21:28.464 19:28:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 2d418b36963005c8c472f2cdd9c61add 0 00:21:28.464 19:28:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # key=2d418b36963005c8c472f2cdd9c61add 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # digest=0 00:21:28.464 19:28:15 -- nvmf/common.sh@694 -- # python - 00:21:28.464 19:28:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.tN9 00:21:28.464 19:28:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.tN9 00:21:28.464 19:28:15 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.tN9 00:21:28.464 19:28:15 -- host/auth.sh@82 -- # gen_key null 48 00:21:28.464 19:28:15 -- host/auth.sh@53 -- # local digest len file key 00:21:28.464 19:28:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:28.464 19:28:15 -- host/auth.sh@54 -- # local -A digests 00:21:28.464 19:28:15 -- host/auth.sh@56 -- # digest=null 00:21:28.464 19:28:15 -- host/auth.sh@56 -- # len=48 00:21:28.464 19:28:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:21:28.464 19:28:15 -- host/auth.sh@57 -- # key=c600b6a0bd16cea344848d5378c394aaa402ea5eafa0afd1 00:21:28.464 19:28:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:21:28.464 19:28:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.fY4 00:21:28.464 19:28:15 -- host/auth.sh@59 -- # format_dhchap_key c600b6a0bd16cea344848d5378c394aaa402ea5eafa0afd1 0 00:21:28.464 19:28:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 c600b6a0bd16cea344848d5378c394aaa402ea5eafa0afd1 0 00:21:28.464 19:28:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # key=c600b6a0bd16cea344848d5378c394aaa402ea5eafa0afd1 00:21:28.464 19:28:15 -- nvmf/common.sh@693 -- # digest=0 00:21:28.465 19:28:15 -- nvmf/common.sh@694 -- # python - 00:21:28.465 19:28:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.fY4 00:21:28.465 19:28:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.fY4 00:21:28.465 19:28:15 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.fY4 00:21:28.465 19:28:15 -- host/auth.sh@83 -- # gen_key sha256 32 00:21:28.465 19:28:15 -- host/auth.sh@53 -- # local digest len file key 00:21:28.465 19:28:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:28.465 19:28:15 -- host/auth.sh@54 -- # local -A digests 00:21:28.465 19:28:15 -- host/auth.sh@56 -- # digest=sha256 00:21:28.465 19:28:15 -- host/auth.sh@56 -- # len=32 00:21:28.465 19:28:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:21:28.465 19:28:15 -- host/auth.sh@57 -- # key=c683d5a6bb85d24a974e850789ae2c0b 00:21:28.465 19:28:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:21:28.465 19:28:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.oxO 00:21:28.465 19:28:15 -- host/auth.sh@59 -- # format_dhchap_key c683d5a6bb85d24a974e850789ae2c0b 1 00:21:28.465 19:28:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 c683d5a6bb85d24a974e850789ae2c0b 1 00:21:28.465 19:28:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # key=c683d5a6bb85d24a974e850789ae2c0b 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # digest=1 00:21:28.465 19:28:15 -- nvmf/common.sh@694 -- # python - 00:21:28.465 19:28:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.oxO 00:21:28.465 19:28:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.oxO 00:21:28.465 19:28:15 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.oxO 00:21:28.465 19:28:15 -- host/auth.sh@84 -- # gen_key sha384 48 00:21:28.465 19:28:15 -- host/auth.sh@53 -- # local digest len file key 00:21:28.465 19:28:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:28.465 19:28:15 -- host/auth.sh@54 -- # local -A digests 00:21:28.465 19:28:15 -- host/auth.sh@56 -- # digest=sha384 00:21:28.465 19:28:15 -- host/auth.sh@56 -- # len=48 00:21:28.465 19:28:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:21:28.465 19:28:15 -- host/auth.sh@57 -- # key=49d1ea5db109599fa2aee4a2a871dd83678c86b40773aa8d 00:21:28.465 19:28:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:21:28.465 19:28:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.Zq8 00:21:28.465 19:28:15 -- host/auth.sh@59 -- # format_dhchap_key 49d1ea5db109599fa2aee4a2a871dd83678c86b40773aa8d 2 00:21:28.465 19:28:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 49d1ea5db109599fa2aee4a2a871dd83678c86b40773aa8d 2 00:21:28.465 19:28:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # key=49d1ea5db109599fa2aee4a2a871dd83678c86b40773aa8d 00:21:28.465 19:28:15 -- nvmf/common.sh@693 -- # digest=2 00:21:28.465 19:28:15 -- nvmf/common.sh@694 -- # python - 00:21:28.723 19:28:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.Zq8 00:21:28.723 19:28:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.Zq8 00:21:28.723 19:28:15 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.Zq8 00:21:28.723 19:28:15 -- host/auth.sh@85 -- # gen_key sha512 64 00:21:28.723 19:28:15 -- host/auth.sh@53 -- # local digest len file key 00:21:28.723 19:28:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:28.723 19:28:15 -- host/auth.sh@54 -- # local -A digests 00:21:28.723 19:28:15 -- host/auth.sh@56 -- # digest=sha512 00:21:28.723 19:28:15 -- host/auth.sh@56 -- # len=64 00:21:28.723 19:28:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:21:28.723 19:28:15 -- host/auth.sh@57 -- # key=99652d7f6d199f31257321982f48a03b421d4fe968b0c0289b933d7db9d3c7ee 00:21:28.723 19:28:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:21:28.723 19:28:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.MtJ 00:21:28.723 19:28:15 -- host/auth.sh@59 -- # format_dhchap_key 99652d7f6d199f31257321982f48a03b421d4fe968b0c0289b933d7db9d3c7ee 3 00:21:28.723 19:28:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 99652d7f6d199f31257321982f48a03b421d4fe968b0c0289b933d7db9d3c7ee 3 00:21:28.723 19:28:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:28.723 19:28:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:28.723 19:28:15 -- nvmf/common.sh@693 -- # key=99652d7f6d199f31257321982f48a03b421d4fe968b0c0289b933d7db9d3c7ee 00:21:28.723 19:28:15 -- nvmf/common.sh@693 -- # digest=3 00:21:28.723 19:28:15 -- nvmf/common.sh@694 -- # python - 00:21:28.723 19:28:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.MtJ 00:21:28.723 19:28:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.MtJ 00:21:28.723 19:28:15 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.MtJ 00:21:28.723 19:28:15 -- host/auth.sh@87 -- # waitforlisten 3099055 00:21:28.723 19:28:15 -- common/autotest_common.sh@817 -- # '[' -z 3099055 ']' 00:21:28.723 19:28:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.723 19:28:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:28.723 19:28:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:28.723 19:28:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:28.723 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.723 19:28:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:28.723 19:28:15 -- common/autotest_common.sh@850 -- # return 0 00:21:28.723 19:28:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:28.723 19:28:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.tN9 00:21:28.723 19:28:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.723 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.723 19:28:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.723 19:28:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:28.723 19:28:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.fY4 00:21:28.723 19:28:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.982 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.982 19:28:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.982 19:28:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:28.982 19:28:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.oxO 00:21:28.982 19:28:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.982 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.982 19:28:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.982 19:28:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:28.982 19:28:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.Zq8 00:21:28.982 19:28:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.982 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.982 19:28:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.982 19:28:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:28.982 19:28:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.MtJ 00:21:28.982 19:28:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.982 19:28:15 -- common/autotest_common.sh@10 -- # set +x 00:21:28.982 19:28:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.982 19:28:15 -- host/auth.sh@92 -- # nvmet_auth_init 00:21:28.982 19:28:15 -- host/auth.sh@35 -- # get_main_ns_ip 00:21:28.982 19:28:15 -- nvmf/common.sh@717 -- # local ip 00:21:28.982 19:28:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:28.982 19:28:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:28.982 19:28:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:28.982 19:28:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:28.982 19:28:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:28.982 19:28:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:28.982 19:28:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:28.982 19:28:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:28.982 19:28:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:28.982 19:28:15 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:21:28.982 19:28:15 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:21:28.982 19:28:15 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:21:28.982 19:28:15 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:28.982 19:28:15 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:21:28.982 19:28:15 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:21:28.982 19:28:15 -- nvmf/common.sh@628 -- # local block nvme 00:21:28.982 19:28:15 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:21:28.982 19:28:15 -- nvmf/common.sh@631 -- # modprobe nvmet 00:21:28.982 19:28:15 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:21:28.982 19:28:15 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:21:32.287 Waiting for block devices as requested 00:21:32.287 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:21:32.287 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:32.287 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:32.287 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:32.287 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:32.545 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:32.545 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:32.545 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:32.804 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:32.804 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:32.804 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:33.061 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:33.061 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:33.061 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:33.319 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:33.319 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:33.319 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:34.252 19:28:21 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:21:34.252 19:28:21 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:21:34.252 19:28:21 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:21:34.252 19:28:21 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:21:34.252 19:28:21 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:21:34.252 19:28:21 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:21:34.252 19:28:21 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:21:34.252 19:28:21 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:21:34.252 19:28:21 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:21:34.252 No valid GPT data, bailing 00:21:34.252 19:28:21 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:21:34.252 19:28:21 -- scripts/common.sh@391 -- # pt= 00:21:34.252 19:28:21 -- scripts/common.sh@392 -- # return 1 00:21:34.252 19:28:21 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:21:34.252 19:28:21 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:21:34.252 19:28:21 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:34.252 19:28:21 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:21:34.252 19:28:21 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:21:34.252 19:28:21 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:21:34.252 19:28:21 -- nvmf/common.sh@656 -- # echo 1 00:21:34.252 19:28:21 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:21:34.252 19:28:21 -- nvmf/common.sh@658 -- # echo 1 00:21:34.252 19:28:21 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:21:34.252 19:28:21 -- nvmf/common.sh@661 -- # echo rdma 00:21:34.252 19:28:21 -- nvmf/common.sh@662 -- # echo 4420 00:21:34.252 19:28:21 -- nvmf/common.sh@663 -- # echo ipv4 00:21:34.252 19:28:21 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:21:34.252 19:28:21 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 --hostid=008e7f2e-322d-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:21:34.509 00:21:34.509 Discovery Log Number of Records 2, Generation counter 2 00:21:34.509 =====Discovery Log Entry 0====== 00:21:34.509 trtype: rdma 00:21:34.509 adrfam: ipv4 00:21:34.509 subtype: current discovery subsystem 00:21:34.509 treq: not specified, sq flow control disable supported 00:21:34.509 portid: 1 00:21:34.509 trsvcid: 4420 00:21:34.509 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:21:34.509 traddr: 192.168.100.8 00:21:34.509 eflags: none 00:21:34.509 rdma_prtype: not specified 00:21:34.509 rdma_qptype: connected 00:21:34.509 rdma_cms: rdma-cm 00:21:34.509 rdma_pkey: 0x0000 00:21:34.509 =====Discovery Log Entry 1====== 00:21:34.509 trtype: rdma 00:21:34.509 adrfam: ipv4 00:21:34.509 subtype: nvme subsystem 00:21:34.509 treq: not specified, sq flow control disable supported 00:21:34.509 portid: 1 00:21:34.509 trsvcid: 4420 00:21:34.509 subnqn: nqn.2024-02.io.spdk:cnode0 00:21:34.509 traddr: 192.168.100.8 00:21:34.509 eflags: none 00:21:34.509 rdma_prtype: not specified 00:21:34.509 rdma_qptype: connected 00:21:34.509 rdma_cms: rdma-cm 00:21:34.509 rdma_pkey: 0x0000 00:21:34.509 19:28:21 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:21:34.509 19:28:21 -- host/auth.sh@37 -- # echo 0 00:21:34.509 19:28:21 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:21:34.509 19:28:21 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:21:34.509 19:28:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:34.509 19:28:21 -- host/auth.sh@44 -- # digest=sha256 00:21:34.509 19:28:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:34.509 19:28:21 -- host/auth.sh@44 -- # keyid=1 00:21:34.509 19:28:21 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:34.509 19:28:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:34.509 19:28:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:34.509 19:28:21 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:34.509 19:28:21 -- host/auth.sh@100 -- # IFS=, 00:21:34.509 19:28:21 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:21:34.509 19:28:21 -- host/auth.sh@100 -- # IFS=, 00:21:34.509 19:28:21 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:34.509 19:28:21 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:21:34.509 19:28:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:34.509 19:28:21 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:21:34.509 19:28:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:34.509 19:28:21 -- host/auth.sh@68 -- # keyid=1 00:21:34.509 19:28:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:34.509 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.509 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:34.509 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:34.509 19:28:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:34.509 19:28:21 -- nvmf/common.sh@717 -- # local ip 00:21:34.509 19:28:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:34.509 19:28:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:34.509 19:28:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:34.509 19:28:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:34.509 19:28:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:34.509 19:28:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:34.509 19:28:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:34.509 19:28:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:34.509 19:28:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:34.509 19:28:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:34.509 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.509 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:34.766 nvme0n1 00:21:34.766 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:34.766 19:28:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:34.766 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.766 19:28:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:34.766 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:34.766 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:34.766 19:28:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:34.766 19:28:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:34.766 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.766 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:34.766 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:34.766 19:28:21 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:21:34.766 19:28:21 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:34.766 19:28:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:34.766 19:28:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:21:34.766 19:28:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:34.766 19:28:21 -- host/auth.sh@44 -- # digest=sha256 00:21:34.766 19:28:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:34.766 19:28:21 -- host/auth.sh@44 -- # keyid=0 00:21:34.766 19:28:21 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:34.766 19:28:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:34.766 19:28:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:34.766 19:28:21 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:34.766 19:28:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:21:34.766 19:28:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:34.766 19:28:21 -- host/auth.sh@68 -- # digest=sha256 00:21:34.766 19:28:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:34.766 19:28:21 -- host/auth.sh@68 -- # keyid=0 00:21:34.766 19:28:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:34.766 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.766 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:34.766 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:34.766 19:28:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:34.766 19:28:21 -- nvmf/common.sh@717 -- # local ip 00:21:34.766 19:28:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:34.766 19:28:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:34.766 19:28:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:34.766 19:28:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:34.766 19:28:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:34.766 19:28:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:34.766 19:28:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:34.766 19:28:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:34.766 19:28:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:34.766 19:28:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:34.766 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:34.766 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:35.024 nvme0n1 00:21:35.024 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.024 19:28:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:35.024 19:28:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:35.024 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.024 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:35.024 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.024 19:28:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:35.024 19:28:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:35.024 19:28:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.024 19:28:21 -- common/autotest_common.sh@10 -- # set +x 00:21:35.024 19:28:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.024 19:28:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:35.024 19:28:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:21:35.024 19:28:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:35.024 19:28:22 -- host/auth.sh@44 -- # digest=sha256 00:21:35.024 19:28:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:35.024 19:28:22 -- host/auth.sh@44 -- # keyid=1 00:21:35.024 19:28:22 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:35.024 19:28:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:35.024 19:28:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:35.024 19:28:22 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:35.024 19:28:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:21:35.024 19:28:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:35.024 19:28:22 -- host/auth.sh@68 -- # digest=sha256 00:21:35.024 19:28:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:35.024 19:28:22 -- host/auth.sh@68 -- # keyid=1 00:21:35.024 19:28:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:35.024 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.024 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.024 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.024 19:28:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:35.024 19:28:22 -- nvmf/common.sh@717 -- # local ip 00:21:35.024 19:28:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:35.024 19:28:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:35.024 19:28:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:35.024 19:28:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:35.024 19:28:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:35.024 19:28:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:35.024 19:28:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:35.024 19:28:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:35.024 19:28:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:35.024 19:28:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:35.024 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.024 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.281 nvme0n1 00:21:35.281 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.281 19:28:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:35.281 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.281 19:28:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:35.281 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.281 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.281 19:28:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:35.281 19:28:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:35.281 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.281 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.281 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.281 19:28:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:35.281 19:28:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:21:35.281 19:28:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:35.281 19:28:22 -- host/auth.sh@44 -- # digest=sha256 00:21:35.281 19:28:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:35.281 19:28:22 -- host/auth.sh@44 -- # keyid=2 00:21:35.281 19:28:22 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:35.281 19:28:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:35.281 19:28:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:35.281 19:28:22 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:35.281 19:28:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:21:35.281 19:28:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:35.281 19:28:22 -- host/auth.sh@68 -- # digest=sha256 00:21:35.281 19:28:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:35.281 19:28:22 -- host/auth.sh@68 -- # keyid=2 00:21:35.281 19:28:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:35.281 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.281 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.281 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.281 19:28:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:35.281 19:28:22 -- nvmf/common.sh@717 -- # local ip 00:21:35.282 19:28:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:35.282 19:28:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:35.282 19:28:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:35.282 19:28:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:35.282 19:28:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:35.282 19:28:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:35.282 19:28:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:35.282 19:28:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:35.282 19:28:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:35.282 19:28:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:35.282 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.282 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.539 nvme0n1 00:21:35.539 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.539 19:28:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:35.539 19:28:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:35.539 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.539 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.539 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.539 19:28:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:35.539 19:28:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:35.539 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.539 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.539 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.539 19:28:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:35.539 19:28:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:21:35.539 19:28:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:35.539 19:28:22 -- host/auth.sh@44 -- # digest=sha256 00:21:35.539 19:28:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:35.539 19:28:22 -- host/auth.sh@44 -- # keyid=3 00:21:35.539 19:28:22 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:35.539 19:28:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:35.539 19:28:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:35.539 19:28:22 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:35.539 19:28:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:21:35.539 19:28:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:35.539 19:28:22 -- host/auth.sh@68 -- # digest=sha256 00:21:35.539 19:28:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:35.539 19:28:22 -- host/auth.sh@68 -- # keyid=3 00:21:35.539 19:28:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:35.539 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.539 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.797 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.797 19:28:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:35.797 19:28:22 -- nvmf/common.sh@717 -- # local ip 00:21:35.797 19:28:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:35.797 19:28:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:35.797 19:28:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:35.797 19:28:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:35.797 19:28:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:35.797 19:28:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:35.797 19:28:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:35.797 19:28:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:35.797 19:28:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:35.797 19:28:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:35.797 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.797 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.797 nvme0n1 00:21:35.797 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.797 19:28:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:35.797 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.797 19:28:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:35.797 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:35.797 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:35.797 19:28:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:35.797 19:28:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:35.797 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:35.797 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:36.054 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.054 19:28:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:36.054 19:28:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:21:36.054 19:28:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:36.054 19:28:22 -- host/auth.sh@44 -- # digest=sha256 00:21:36.054 19:28:22 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:36.054 19:28:22 -- host/auth.sh@44 -- # keyid=4 00:21:36.054 19:28:22 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:36.054 19:28:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:36.054 19:28:22 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:36.054 19:28:22 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:36.054 19:28:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:21:36.054 19:28:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:36.054 19:28:22 -- host/auth.sh@68 -- # digest=sha256 00:21:36.054 19:28:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:36.054 19:28:22 -- host/auth.sh@68 -- # keyid=4 00:21:36.054 19:28:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:36.054 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.054 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:36.054 19:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.054 19:28:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:36.054 19:28:22 -- nvmf/common.sh@717 -- # local ip 00:21:36.054 19:28:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:36.054 19:28:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:36.054 19:28:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:36.054 19:28:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:36.055 19:28:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:36.055 19:28:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:36.055 19:28:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:36.055 19:28:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:36.055 19:28:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:36.055 19:28:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:36.055 19:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.055 19:28:22 -- common/autotest_common.sh@10 -- # set +x 00:21:36.055 nvme0n1 00:21:36.055 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.055 19:28:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:36.055 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.055 19:28:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:36.055 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.055 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.055 19:28:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:36.055 19:28:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:36.055 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.055 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.314 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.314 19:28:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:36.314 19:28:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:36.314 19:28:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:21:36.314 19:28:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:36.314 19:28:23 -- host/auth.sh@44 -- # digest=sha256 00:21:36.314 19:28:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:36.314 19:28:23 -- host/auth.sh@44 -- # keyid=0 00:21:36.314 19:28:23 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:36.314 19:28:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:36.314 19:28:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:36.314 19:28:23 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:36.314 19:28:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:21:36.314 19:28:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:36.314 19:28:23 -- host/auth.sh@68 -- # digest=sha256 00:21:36.314 19:28:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:36.315 19:28:23 -- host/auth.sh@68 -- # keyid=0 00:21:36.315 19:28:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:36.315 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.315 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.315 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.315 19:28:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:36.315 19:28:23 -- nvmf/common.sh@717 -- # local ip 00:21:36.315 19:28:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:36.315 19:28:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:36.315 19:28:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:36.315 19:28:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:36.315 19:28:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:36.315 19:28:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:36.315 19:28:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:36.315 19:28:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:36.315 19:28:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:36.315 19:28:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:36.315 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.315 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.625 nvme0n1 00:21:36.625 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.625 19:28:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:36.625 19:28:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:36.625 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.625 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.625 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.625 19:28:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:36.625 19:28:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:36.625 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.625 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.625 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.625 19:28:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:36.625 19:28:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:21:36.625 19:28:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:36.625 19:28:23 -- host/auth.sh@44 -- # digest=sha256 00:21:36.625 19:28:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:36.625 19:28:23 -- host/auth.sh@44 -- # keyid=1 00:21:36.625 19:28:23 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:36.625 19:28:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:36.625 19:28:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:36.625 19:28:23 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:36.625 19:28:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:21:36.625 19:28:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:36.625 19:28:23 -- host/auth.sh@68 -- # digest=sha256 00:21:36.625 19:28:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:36.625 19:28:23 -- host/auth.sh@68 -- # keyid=1 00:21:36.625 19:28:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:36.625 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.625 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.625 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.625 19:28:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:36.625 19:28:23 -- nvmf/common.sh@717 -- # local ip 00:21:36.625 19:28:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:36.625 19:28:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:36.625 19:28:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:36.625 19:28:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:36.625 19:28:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:36.625 19:28:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:36.625 19:28:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:36.625 19:28:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:36.625 19:28:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:36.625 19:28:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:36.625 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.625 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.901 nvme0n1 00:21:36.901 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.901 19:28:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:36.901 19:28:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:36.901 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.901 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.901 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.901 19:28:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:36.901 19:28:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:36.901 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.901 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.901 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.901 19:28:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:36.901 19:28:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:21:36.901 19:28:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:36.901 19:28:23 -- host/auth.sh@44 -- # digest=sha256 00:21:36.901 19:28:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:36.901 19:28:23 -- host/auth.sh@44 -- # keyid=2 00:21:36.901 19:28:23 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:36.901 19:28:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:36.901 19:28:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:36.901 19:28:23 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:36.901 19:28:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:21:36.901 19:28:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:36.901 19:28:23 -- host/auth.sh@68 -- # digest=sha256 00:21:36.901 19:28:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:36.901 19:28:23 -- host/auth.sh@68 -- # keyid=2 00:21:36.901 19:28:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:36.901 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.901 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:36.901 19:28:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.901 19:28:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:36.901 19:28:23 -- nvmf/common.sh@717 -- # local ip 00:21:36.901 19:28:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:36.901 19:28:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:36.901 19:28:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:36.901 19:28:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:36.901 19:28:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:36.901 19:28:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:36.901 19:28:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:36.901 19:28:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:36.901 19:28:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:36.901 19:28:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:36.901 19:28:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.901 19:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:37.160 nvme0n1 00:21:37.160 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.160 19:28:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:37.160 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.160 19:28:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:37.160 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.160 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.160 19:28:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:37.160 19:28:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:37.160 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.160 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.160 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.160 19:28:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:37.160 19:28:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:21:37.160 19:28:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:37.160 19:28:24 -- host/auth.sh@44 -- # digest=sha256 00:21:37.160 19:28:24 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:37.160 19:28:24 -- host/auth.sh@44 -- # keyid=3 00:21:37.160 19:28:24 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:37.160 19:28:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:37.160 19:28:24 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:37.160 19:28:24 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:37.160 19:28:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:21:37.160 19:28:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:37.160 19:28:24 -- host/auth.sh@68 -- # digest=sha256 00:21:37.160 19:28:24 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:37.160 19:28:24 -- host/auth.sh@68 -- # keyid=3 00:21:37.160 19:28:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:37.160 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.160 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.418 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.418 19:28:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:37.418 19:28:24 -- nvmf/common.sh@717 -- # local ip 00:21:37.418 19:28:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:37.418 19:28:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:37.418 19:28:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:37.418 19:28:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:37.418 19:28:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:37.418 19:28:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:37.418 19:28:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:37.418 19:28:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:37.418 19:28:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:37.419 19:28:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:37.419 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.419 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.419 nvme0n1 00:21:37.419 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.419 19:28:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:37.419 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.419 19:28:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:37.419 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.419 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.676 19:28:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:37.676 19:28:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:37.677 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.677 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.677 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.677 19:28:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:37.677 19:28:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:21:37.677 19:28:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:37.677 19:28:24 -- host/auth.sh@44 -- # digest=sha256 00:21:37.677 19:28:24 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:37.677 19:28:24 -- host/auth.sh@44 -- # keyid=4 00:21:37.677 19:28:24 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:37.677 19:28:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:37.677 19:28:24 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:37.677 19:28:24 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:37.677 19:28:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:21:37.677 19:28:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:37.677 19:28:24 -- host/auth.sh@68 -- # digest=sha256 00:21:37.677 19:28:24 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:37.677 19:28:24 -- host/auth.sh@68 -- # keyid=4 00:21:37.677 19:28:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:37.677 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.677 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.677 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.677 19:28:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:37.677 19:28:24 -- nvmf/common.sh@717 -- # local ip 00:21:37.677 19:28:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:37.677 19:28:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:37.677 19:28:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:37.677 19:28:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:37.677 19:28:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:37.677 19:28:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:37.677 19:28:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:37.677 19:28:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:37.677 19:28:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:37.677 19:28:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:37.677 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.677 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.677 nvme0n1 00:21:37.677 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.677 19:28:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:37.677 19:28:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:37.677 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.677 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.934 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.934 19:28:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:37.934 19:28:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:37.934 19:28:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.934 19:28:24 -- common/autotest_common.sh@10 -- # set +x 00:21:37.934 19:28:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.934 19:28:24 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:37.934 19:28:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:37.934 19:28:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:21:37.934 19:28:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:37.934 19:28:24 -- host/auth.sh@44 -- # digest=sha256 00:21:37.934 19:28:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:37.934 19:28:24 -- host/auth.sh@44 -- # keyid=0 00:21:37.934 19:28:24 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:37.934 19:28:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:37.934 19:28:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:38.192 19:28:25 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:38.192 19:28:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:21:38.192 19:28:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:38.192 19:28:25 -- host/auth.sh@68 -- # digest=sha256 00:21:38.192 19:28:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:38.192 19:28:25 -- host/auth.sh@68 -- # keyid=0 00:21:38.192 19:28:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:38.192 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.192 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.192 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.192 19:28:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:38.192 19:28:25 -- nvmf/common.sh@717 -- # local ip 00:21:38.192 19:28:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:38.192 19:28:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:38.192 19:28:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:38.192 19:28:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:38.192 19:28:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:38.192 19:28:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:38.192 19:28:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:38.192 19:28:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:38.192 19:28:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:38.192 19:28:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:38.192 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.192 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.450 nvme0n1 00:21:38.450 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.450 19:28:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:38.450 19:28:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:38.450 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.450 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.450 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.708 19:28:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:38.708 19:28:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:38.708 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.708 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.708 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.708 19:28:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:38.708 19:28:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:21:38.708 19:28:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:38.708 19:28:25 -- host/auth.sh@44 -- # digest=sha256 00:21:38.708 19:28:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:38.708 19:28:25 -- host/auth.sh@44 -- # keyid=1 00:21:38.708 19:28:25 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:38.708 19:28:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:38.708 19:28:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:38.708 19:28:25 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:38.708 19:28:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:21:38.708 19:28:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:38.708 19:28:25 -- host/auth.sh@68 -- # digest=sha256 00:21:38.708 19:28:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:38.708 19:28:25 -- host/auth.sh@68 -- # keyid=1 00:21:38.708 19:28:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:38.708 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.708 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.708 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.708 19:28:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:38.708 19:28:25 -- nvmf/common.sh@717 -- # local ip 00:21:38.708 19:28:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:38.708 19:28:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:38.708 19:28:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:38.708 19:28:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:38.708 19:28:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:38.708 19:28:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:38.708 19:28:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:38.708 19:28:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:38.708 19:28:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:38.708 19:28:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:38.708 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.708 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.967 nvme0n1 00:21:38.967 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.967 19:28:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:38.967 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.967 19:28:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:38.967 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.967 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.967 19:28:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:38.967 19:28:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:38.967 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.967 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.967 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.967 19:28:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:38.967 19:28:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:21:38.967 19:28:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:38.967 19:28:25 -- host/auth.sh@44 -- # digest=sha256 00:21:38.967 19:28:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:38.967 19:28:25 -- host/auth.sh@44 -- # keyid=2 00:21:38.967 19:28:25 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:38.967 19:28:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:38.967 19:28:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:38.967 19:28:25 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:38.967 19:28:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:21:38.967 19:28:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:38.967 19:28:25 -- host/auth.sh@68 -- # digest=sha256 00:21:38.967 19:28:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:38.967 19:28:25 -- host/auth.sh@68 -- # keyid=2 00:21:38.967 19:28:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:38.967 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.967 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:38.967 19:28:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.967 19:28:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:38.967 19:28:25 -- nvmf/common.sh@717 -- # local ip 00:21:38.967 19:28:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:38.967 19:28:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:38.967 19:28:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:38.967 19:28:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:38.967 19:28:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:38.967 19:28:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:38.967 19:28:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:38.967 19:28:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:38.967 19:28:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:38.967 19:28:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:38.967 19:28:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.967 19:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:39.225 nvme0n1 00:21:39.225 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.225 19:28:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:39.225 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.225 19:28:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:39.225 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.225 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.225 19:28:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:39.225 19:28:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:39.225 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.225 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.225 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.225 19:28:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:39.225 19:28:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:21:39.225 19:28:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:39.225 19:28:26 -- host/auth.sh@44 -- # digest=sha256 00:21:39.225 19:28:26 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:39.225 19:28:26 -- host/auth.sh@44 -- # keyid=3 00:21:39.225 19:28:26 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:39.225 19:28:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:39.225 19:28:26 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:39.225 19:28:26 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:39.225 19:28:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:21:39.225 19:28:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:39.225 19:28:26 -- host/auth.sh@68 -- # digest=sha256 00:21:39.225 19:28:26 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:39.225 19:28:26 -- host/auth.sh@68 -- # keyid=3 00:21:39.225 19:28:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:39.225 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.225 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.225 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.225 19:28:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:39.225 19:28:26 -- nvmf/common.sh@717 -- # local ip 00:21:39.225 19:28:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:39.225 19:28:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:39.225 19:28:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:39.225 19:28:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:39.225 19:28:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:39.225 19:28:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:39.225 19:28:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:39.225 19:28:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:39.225 19:28:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:39.226 19:28:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:39.226 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.226 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.483 nvme0n1 00:21:39.483 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.483 19:28:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:39.483 19:28:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:39.483 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.483 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.483 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.483 19:28:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:39.483 19:28:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:39.483 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.483 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.741 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.741 19:28:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:39.741 19:28:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:21:39.741 19:28:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:39.741 19:28:26 -- host/auth.sh@44 -- # digest=sha256 00:21:39.741 19:28:26 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:39.741 19:28:26 -- host/auth.sh@44 -- # keyid=4 00:21:39.741 19:28:26 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:39.741 19:28:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:39.741 19:28:26 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:39.741 19:28:26 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:39.741 19:28:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:21:39.741 19:28:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:39.741 19:28:26 -- host/auth.sh@68 -- # digest=sha256 00:21:39.741 19:28:26 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:39.741 19:28:26 -- host/auth.sh@68 -- # keyid=4 00:21:39.741 19:28:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:39.741 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.741 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.741 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.741 19:28:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:39.741 19:28:26 -- nvmf/common.sh@717 -- # local ip 00:21:39.741 19:28:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:39.741 19:28:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:39.741 19:28:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:39.741 19:28:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:39.741 19:28:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:39.741 19:28:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:39.741 19:28:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:39.741 19:28:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:39.741 19:28:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:39.741 19:28:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:39.741 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.741 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.999 nvme0n1 00:21:39.999 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.999 19:28:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:39.999 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.999 19:28:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:39.999 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.999 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.999 19:28:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:39.999 19:28:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:39.999 19:28:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.999 19:28:26 -- common/autotest_common.sh@10 -- # set +x 00:21:39.999 19:28:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.999 19:28:26 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:39.999 19:28:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:39.999 19:28:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:21:39.999 19:28:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:39.999 19:28:26 -- host/auth.sh@44 -- # digest=sha256 00:21:39.999 19:28:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:39.999 19:28:26 -- host/auth.sh@44 -- # keyid=0 00:21:39.999 19:28:26 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:39.999 19:28:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:39.999 19:28:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:41.373 19:28:28 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:41.373 19:28:28 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:21:41.373 19:28:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:41.373 19:28:28 -- host/auth.sh@68 -- # digest=sha256 00:21:41.373 19:28:28 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:41.373 19:28:28 -- host/auth.sh@68 -- # keyid=0 00:21:41.373 19:28:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:41.373 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.373 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:41.373 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.373 19:28:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:41.373 19:28:28 -- nvmf/common.sh@717 -- # local ip 00:21:41.373 19:28:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:41.373 19:28:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:41.373 19:28:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:41.373 19:28:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:41.373 19:28:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:41.373 19:28:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:41.373 19:28:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:41.373 19:28:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:41.373 19:28:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:41.373 19:28:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:41.373 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.373 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:41.631 nvme0n1 00:21:41.631 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.631 19:28:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:41.631 19:28:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:41.631 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.631 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:41.631 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.632 19:28:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:41.632 19:28:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:41.632 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.632 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:41.632 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.632 19:28:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:41.632 19:28:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:21:41.632 19:28:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:41.632 19:28:28 -- host/auth.sh@44 -- # digest=sha256 00:21:41.632 19:28:28 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:41.632 19:28:28 -- host/auth.sh@44 -- # keyid=1 00:21:41.632 19:28:28 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:41.632 19:28:28 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:41.632 19:28:28 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:41.632 19:28:28 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:41.632 19:28:28 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:21:41.632 19:28:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:41.632 19:28:28 -- host/auth.sh@68 -- # digest=sha256 00:21:41.632 19:28:28 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:41.632 19:28:28 -- host/auth.sh@68 -- # keyid=1 00:21:41.632 19:28:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:41.632 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.632 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:41.632 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.632 19:28:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:41.632 19:28:28 -- nvmf/common.sh@717 -- # local ip 00:21:41.632 19:28:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:41.632 19:28:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:41.632 19:28:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:41.632 19:28:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:41.632 19:28:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:41.632 19:28:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:41.632 19:28:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:41.632 19:28:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:41.632 19:28:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:41.632 19:28:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:41.632 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.632 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:42.198 nvme0n1 00:21:42.198 19:28:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.198 19:28:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:42.198 19:28:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.198 19:28:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:42.198 19:28:28 -- common/autotest_common.sh@10 -- # set +x 00:21:42.198 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.198 19:28:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:42.198 19:28:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:42.198 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.198 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.198 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.198 19:28:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:42.198 19:28:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:21:42.198 19:28:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:42.198 19:28:29 -- host/auth.sh@44 -- # digest=sha256 00:21:42.198 19:28:29 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:42.198 19:28:29 -- host/auth.sh@44 -- # keyid=2 00:21:42.198 19:28:29 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:42.198 19:28:29 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:42.198 19:28:29 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:42.198 19:28:29 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:42.198 19:28:29 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:21:42.198 19:28:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:42.198 19:28:29 -- host/auth.sh@68 -- # digest=sha256 00:21:42.198 19:28:29 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:42.198 19:28:29 -- host/auth.sh@68 -- # keyid=2 00:21:42.198 19:28:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:42.198 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.198 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.198 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.198 19:28:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:42.198 19:28:29 -- nvmf/common.sh@717 -- # local ip 00:21:42.198 19:28:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:42.198 19:28:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:42.198 19:28:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:42.198 19:28:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:42.198 19:28:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:42.198 19:28:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:42.198 19:28:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:42.198 19:28:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:42.198 19:28:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:42.199 19:28:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:42.199 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.199 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.456 nvme0n1 00:21:42.456 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.456 19:28:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:42.456 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.456 19:28:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:42.456 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.456 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.714 19:28:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:42.714 19:28:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:42.714 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.714 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.714 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.714 19:28:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:42.714 19:28:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:21:42.714 19:28:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:42.714 19:28:29 -- host/auth.sh@44 -- # digest=sha256 00:21:42.714 19:28:29 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:42.714 19:28:29 -- host/auth.sh@44 -- # keyid=3 00:21:42.714 19:28:29 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:42.714 19:28:29 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:42.714 19:28:29 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:42.714 19:28:29 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:42.715 19:28:29 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:21:42.715 19:28:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:42.715 19:28:29 -- host/auth.sh@68 -- # digest=sha256 00:21:42.715 19:28:29 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:42.715 19:28:29 -- host/auth.sh@68 -- # keyid=3 00:21:42.715 19:28:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:42.715 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.715 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.715 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.715 19:28:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:42.715 19:28:29 -- nvmf/common.sh@717 -- # local ip 00:21:42.715 19:28:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:42.715 19:28:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:42.715 19:28:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:42.715 19:28:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:42.715 19:28:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:42.715 19:28:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:42.715 19:28:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:42.715 19:28:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:42.715 19:28:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:42.715 19:28:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:42.715 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.715 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.995 nvme0n1 00:21:42.995 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.995 19:28:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:42.995 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.995 19:28:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:42.995 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.995 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.995 19:28:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:42.995 19:28:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:42.995 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.995 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.995 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.995 19:28:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:42.995 19:28:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:21:42.995 19:28:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:42.995 19:28:29 -- host/auth.sh@44 -- # digest=sha256 00:21:42.995 19:28:29 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:42.995 19:28:29 -- host/auth.sh@44 -- # keyid=4 00:21:42.995 19:28:29 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:42.995 19:28:29 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:42.995 19:28:29 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:42.995 19:28:29 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:42.995 19:28:29 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:21:42.995 19:28:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:42.995 19:28:29 -- host/auth.sh@68 -- # digest=sha256 00:21:42.995 19:28:29 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:42.995 19:28:29 -- host/auth.sh@68 -- # keyid=4 00:21:42.995 19:28:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:42.995 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.995 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:42.995 19:28:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.995 19:28:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:42.995 19:28:29 -- nvmf/common.sh@717 -- # local ip 00:21:42.995 19:28:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:42.995 19:28:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:42.995 19:28:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:42.995 19:28:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:42.995 19:28:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:42.995 19:28:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:42.995 19:28:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:42.995 19:28:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:42.995 19:28:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:42.995 19:28:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:42.995 19:28:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.995 19:28:29 -- common/autotest_common.sh@10 -- # set +x 00:21:43.561 nvme0n1 00:21:43.562 19:28:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.562 19:28:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:43.562 19:28:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:43.562 19:28:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.562 19:28:30 -- common/autotest_common.sh@10 -- # set +x 00:21:43.562 19:28:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.562 19:28:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:43.562 19:28:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:43.562 19:28:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.562 19:28:30 -- common/autotest_common.sh@10 -- # set +x 00:21:43.562 19:28:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.562 19:28:30 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:43.562 19:28:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:43.562 19:28:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:21:43.562 19:28:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:43.562 19:28:30 -- host/auth.sh@44 -- # digest=sha256 00:21:43.562 19:28:30 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:43.562 19:28:30 -- host/auth.sh@44 -- # keyid=0 00:21:43.562 19:28:30 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:43.562 19:28:30 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:43.562 19:28:30 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:46.841 19:28:33 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:46.841 19:28:33 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:21:46.841 19:28:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:46.841 19:28:33 -- host/auth.sh@68 -- # digest=sha256 00:21:46.841 19:28:33 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:46.841 19:28:33 -- host/auth.sh@68 -- # keyid=0 00:21:46.841 19:28:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:46.841 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.841 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:46.841 19:28:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.841 19:28:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:46.841 19:28:33 -- nvmf/common.sh@717 -- # local ip 00:21:46.841 19:28:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:46.841 19:28:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:46.841 19:28:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:46.841 19:28:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:46.841 19:28:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:46.841 19:28:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:46.841 19:28:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:46.841 19:28:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:46.841 19:28:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:46.841 19:28:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:46.841 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.841 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:46.841 nvme0n1 00:21:46.841 19:28:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.841 19:28:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:46.841 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.841 19:28:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:46.841 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:46.841 19:28:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.099 19:28:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:47.099 19:28:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:47.099 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.099 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:47.099 19:28:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.099 19:28:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:47.099 19:28:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:21:47.099 19:28:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:47.099 19:28:33 -- host/auth.sh@44 -- # digest=sha256 00:21:47.099 19:28:33 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:47.099 19:28:33 -- host/auth.sh@44 -- # keyid=1 00:21:47.099 19:28:33 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:47.099 19:28:33 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:47.099 19:28:33 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:47.099 19:28:33 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:47.099 19:28:33 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:21:47.099 19:28:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:47.099 19:28:33 -- host/auth.sh@68 -- # digest=sha256 00:21:47.099 19:28:33 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:47.100 19:28:33 -- host/auth.sh@68 -- # keyid=1 00:21:47.100 19:28:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:47.100 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.100 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:47.100 19:28:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.100 19:28:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:47.100 19:28:33 -- nvmf/common.sh@717 -- # local ip 00:21:47.100 19:28:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:47.100 19:28:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:47.100 19:28:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:47.100 19:28:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:47.100 19:28:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:47.100 19:28:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:47.100 19:28:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:47.100 19:28:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:47.100 19:28:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:47.100 19:28:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:47.100 19:28:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.100 19:28:33 -- common/autotest_common.sh@10 -- # set +x 00:21:47.666 nvme0n1 00:21:47.666 19:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.666 19:28:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:47.666 19:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.666 19:28:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:47.666 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:21:47.666 19:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.666 19:28:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:47.666 19:28:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:47.666 19:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.666 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:21:47.666 19:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.666 19:28:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:47.666 19:28:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:21:47.666 19:28:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:47.666 19:28:34 -- host/auth.sh@44 -- # digest=sha256 00:21:47.666 19:28:34 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:47.666 19:28:34 -- host/auth.sh@44 -- # keyid=2 00:21:47.666 19:28:34 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:47.666 19:28:34 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:47.666 19:28:34 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:47.666 19:28:34 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:47.666 19:28:34 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:21:47.666 19:28:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:47.666 19:28:34 -- host/auth.sh@68 -- # digest=sha256 00:21:47.666 19:28:34 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:47.666 19:28:34 -- host/auth.sh@68 -- # keyid=2 00:21:47.666 19:28:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:47.666 19:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.666 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:21:47.666 19:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.666 19:28:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:47.666 19:28:34 -- nvmf/common.sh@717 -- # local ip 00:21:47.666 19:28:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:47.666 19:28:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:47.666 19:28:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:47.666 19:28:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:47.666 19:28:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:47.666 19:28:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:47.666 19:28:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:47.666 19:28:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:47.666 19:28:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:47.666 19:28:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:47.666 19:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.666 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:21:48.232 nvme0n1 00:21:48.232 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.232 19:28:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:48.232 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.232 19:28:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:48.232 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:48.232 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.232 19:28:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:48.232 19:28:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:48.232 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.232 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:48.232 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.232 19:28:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:48.232 19:28:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:21:48.233 19:28:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:48.233 19:28:35 -- host/auth.sh@44 -- # digest=sha256 00:21:48.233 19:28:35 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:48.233 19:28:35 -- host/auth.sh@44 -- # keyid=3 00:21:48.233 19:28:35 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:48.233 19:28:35 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:48.233 19:28:35 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:48.233 19:28:35 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:48.233 19:28:35 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:21:48.233 19:28:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:48.233 19:28:35 -- host/auth.sh@68 -- # digest=sha256 00:21:48.233 19:28:35 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:48.233 19:28:35 -- host/auth.sh@68 -- # keyid=3 00:21:48.233 19:28:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:48.233 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.233 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:48.233 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.233 19:28:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:48.233 19:28:35 -- nvmf/common.sh@717 -- # local ip 00:21:48.233 19:28:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:48.233 19:28:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:48.233 19:28:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:48.233 19:28:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:48.233 19:28:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:48.233 19:28:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:48.233 19:28:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:48.233 19:28:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:48.233 19:28:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:48.233 19:28:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:48.233 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.233 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:48.799 nvme0n1 00:21:48.799 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.799 19:28:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:48.799 19:28:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:48.799 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.799 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:48.799 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.799 19:28:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:48.799 19:28:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:48.799 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.799 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:49.057 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.057 19:28:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.057 19:28:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:21:49.057 19:28:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.057 19:28:35 -- host/auth.sh@44 -- # digest=sha256 00:21:49.057 19:28:35 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:49.057 19:28:35 -- host/auth.sh@44 -- # keyid=4 00:21:49.057 19:28:35 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:49.057 19:28:35 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:49.057 19:28:35 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:49.057 19:28:35 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:49.057 19:28:35 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:21:49.057 19:28:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.057 19:28:35 -- host/auth.sh@68 -- # digest=sha256 00:21:49.057 19:28:35 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:49.057 19:28:35 -- host/auth.sh@68 -- # keyid=4 00:21:49.057 19:28:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:49.057 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.057 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:49.057 19:28:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.057 19:28:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.057 19:28:35 -- nvmf/common.sh@717 -- # local ip 00:21:49.057 19:28:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.057 19:28:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.057 19:28:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.057 19:28:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.057 19:28:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.057 19:28:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.057 19:28:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.057 19:28:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.057 19:28:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.057 19:28:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:49.057 19:28:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.057 19:28:35 -- common/autotest_common.sh@10 -- # set +x 00:21:49.635 nvme0n1 00:21:49.635 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.635 19:28:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.635 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.635 19:28:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.635 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.635 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.635 19:28:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:49.635 19:28:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:49.635 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.635 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.635 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.635 19:28:36 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:21:49.635 19:28:36 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:49.635 19:28:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.635 19:28:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:21:49.635 19:28:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.635 19:28:36 -- host/auth.sh@44 -- # digest=sha384 00:21:49.635 19:28:36 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.635 19:28:36 -- host/auth.sh@44 -- # keyid=0 00:21:49.635 19:28:36 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:49.635 19:28:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:49.635 19:28:36 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.635 19:28:36 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:49.635 19:28:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:21:49.635 19:28:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.635 19:28:36 -- host/auth.sh@68 -- # digest=sha384 00:21:49.635 19:28:36 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.635 19:28:36 -- host/auth.sh@68 -- # keyid=0 00:21:49.635 19:28:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:49.635 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.635 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.635 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.635 19:28:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.635 19:28:36 -- nvmf/common.sh@717 -- # local ip 00:21:49.635 19:28:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.635 19:28:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.635 19:28:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.635 19:28:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.635 19:28:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.635 19:28:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.635 19:28:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.635 19:28:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.635 19:28:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.635 19:28:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:49.635 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.635 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.893 nvme0n1 00:21:49.893 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.893 19:28:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.893 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.893 19:28:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.893 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.893 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.893 19:28:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:49.893 19:28:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:49.893 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.893 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.893 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.893 19:28:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.893 19:28:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:21:49.893 19:28:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.893 19:28:36 -- host/auth.sh@44 -- # digest=sha384 00:21:49.893 19:28:36 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.893 19:28:36 -- host/auth.sh@44 -- # keyid=1 00:21:49.893 19:28:36 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:49.893 19:28:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:49.893 19:28:36 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.893 19:28:36 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:49.893 19:28:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:21:49.893 19:28:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.893 19:28:36 -- host/auth.sh@68 -- # digest=sha384 00:21:49.893 19:28:36 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.893 19:28:36 -- host/auth.sh@68 -- # keyid=1 00:21:49.893 19:28:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:49.893 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.893 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:49.893 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:49.893 19:28:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.893 19:28:36 -- nvmf/common.sh@717 -- # local ip 00:21:49.893 19:28:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.893 19:28:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.893 19:28:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.893 19:28:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.893 19:28:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.893 19:28:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.893 19:28:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.893 19:28:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.893 19:28:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.893 19:28:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:49.893 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:49.893 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:50.150 nvme0n1 00:21:50.150 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.150 19:28:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.150 19:28:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.150 19:28:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.150 19:28:36 -- common/autotest_common.sh@10 -- # set +x 00:21:50.150 19:28:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.150 19:28:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.150 19:28:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.151 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.151 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.151 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.151 19:28:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.151 19:28:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:21:50.151 19:28:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.151 19:28:37 -- host/auth.sh@44 -- # digest=sha384 00:21:50.151 19:28:37 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:50.151 19:28:37 -- host/auth.sh@44 -- # keyid=2 00:21:50.151 19:28:37 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:50.151 19:28:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:50.151 19:28:37 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:50.151 19:28:37 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:50.151 19:28:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:21:50.151 19:28:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.151 19:28:37 -- host/auth.sh@68 -- # digest=sha384 00:21:50.151 19:28:37 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:50.151 19:28:37 -- host/auth.sh@68 -- # keyid=2 00:21:50.151 19:28:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:50.151 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.151 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.151 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.151 19:28:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.151 19:28:37 -- nvmf/common.sh@717 -- # local ip 00:21:50.151 19:28:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.151 19:28:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.151 19:28:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.151 19:28:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.151 19:28:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.151 19:28:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.151 19:28:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.151 19:28:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.151 19:28:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.151 19:28:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:50.151 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.151 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.409 nvme0n1 00:21:50.409 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.409 19:28:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.409 19:28:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.409 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.409 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.409 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.409 19:28:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.409 19:28:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.409 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.409 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.409 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.409 19:28:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.409 19:28:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:21:50.409 19:28:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.409 19:28:37 -- host/auth.sh@44 -- # digest=sha384 00:21:50.409 19:28:37 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:50.409 19:28:37 -- host/auth.sh@44 -- # keyid=3 00:21:50.409 19:28:37 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:50.409 19:28:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:50.409 19:28:37 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:50.409 19:28:37 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:50.409 19:28:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:21:50.409 19:28:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.409 19:28:37 -- host/auth.sh@68 -- # digest=sha384 00:21:50.409 19:28:37 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:50.409 19:28:37 -- host/auth.sh@68 -- # keyid=3 00:21:50.409 19:28:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:50.409 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.409 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.409 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.409 19:28:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.409 19:28:37 -- nvmf/common.sh@717 -- # local ip 00:21:50.409 19:28:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.409 19:28:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.409 19:28:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.409 19:28:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.409 19:28:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.409 19:28:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.409 19:28:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.409 19:28:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.409 19:28:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.409 19:28:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:50.409 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.409 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.666 nvme0n1 00:21:50.666 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.666 19:28:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.666 19:28:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.666 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.666 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.666 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.666 19:28:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.666 19:28:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.666 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.666 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.666 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.666 19:28:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.666 19:28:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:21:50.666 19:28:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.666 19:28:37 -- host/auth.sh@44 -- # digest=sha384 00:21:50.666 19:28:37 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:50.666 19:28:37 -- host/auth.sh@44 -- # keyid=4 00:21:50.667 19:28:37 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:50.667 19:28:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:50.667 19:28:37 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:50.667 19:28:37 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:50.667 19:28:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:21:50.667 19:28:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.667 19:28:37 -- host/auth.sh@68 -- # digest=sha384 00:21:50.667 19:28:37 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:50.667 19:28:37 -- host/auth.sh@68 -- # keyid=4 00:21:50.667 19:28:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:50.667 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.667 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.667 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.667 19:28:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.667 19:28:37 -- nvmf/common.sh@717 -- # local ip 00:21:50.667 19:28:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.667 19:28:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.667 19:28:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.667 19:28:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.667 19:28:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.667 19:28:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.667 19:28:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.667 19:28:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.667 19:28:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.667 19:28:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:50.667 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.667 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.925 nvme0n1 00:21:50.925 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.925 19:28:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.925 19:28:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.925 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.925 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.925 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.925 19:28:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.925 19:28:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.925 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.925 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.925 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.925 19:28:37 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:50.925 19:28:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.925 19:28:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:21:50.925 19:28:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.925 19:28:37 -- host/auth.sh@44 -- # digest=sha384 00:21:50.925 19:28:37 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:50.925 19:28:37 -- host/auth.sh@44 -- # keyid=0 00:21:50.925 19:28:37 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:50.925 19:28:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:50.925 19:28:37 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:50.925 19:28:37 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:50.925 19:28:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:21:50.925 19:28:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.925 19:28:37 -- host/auth.sh@68 -- # digest=sha384 00:21:50.925 19:28:37 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:50.925 19:28:37 -- host/auth.sh@68 -- # keyid=0 00:21:50.925 19:28:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:21:50.925 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.925 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:50.925 19:28:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:50.925 19:28:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.925 19:28:37 -- nvmf/common.sh@717 -- # local ip 00:21:50.925 19:28:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.925 19:28:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.925 19:28:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.925 19:28:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.925 19:28:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.925 19:28:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.925 19:28:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.925 19:28:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.925 19:28:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.925 19:28:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:50.925 19:28:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:50.925 19:28:37 -- common/autotest_common.sh@10 -- # set +x 00:21:51.183 nvme0n1 00:21:51.183 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.183 19:28:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.183 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.183 19:28:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.183 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.183 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.183 19:28:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.183 19:28:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.183 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.183 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.183 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.183 19:28:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.183 19:28:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:21:51.183 19:28:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.183 19:28:38 -- host/auth.sh@44 -- # digest=sha384 00:21:51.183 19:28:38 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:51.183 19:28:38 -- host/auth.sh@44 -- # keyid=1 00:21:51.183 19:28:38 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:51.183 19:28:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:51.183 19:28:38 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:51.183 19:28:38 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:51.183 19:28:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:21:51.183 19:28:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.183 19:28:38 -- host/auth.sh@68 -- # digest=sha384 00:21:51.183 19:28:38 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:51.183 19:28:38 -- host/auth.sh@68 -- # keyid=1 00:21:51.183 19:28:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:21:51.183 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.183 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.183 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.183 19:28:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.183 19:28:38 -- nvmf/common.sh@717 -- # local ip 00:21:51.183 19:28:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.183 19:28:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.183 19:28:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.183 19:28:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.183 19:28:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.183 19:28:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.183 19:28:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.183 19:28:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.183 19:28:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.183 19:28:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:51.183 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.183 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.441 nvme0n1 00:21:51.441 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.441 19:28:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.441 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.441 19:28:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.441 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.441 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.441 19:28:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.441 19:28:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.441 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.441 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.441 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.441 19:28:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.441 19:28:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:21:51.441 19:28:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.441 19:28:38 -- host/auth.sh@44 -- # digest=sha384 00:21:51.441 19:28:38 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:51.441 19:28:38 -- host/auth.sh@44 -- # keyid=2 00:21:51.441 19:28:38 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:51.441 19:28:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:51.441 19:28:38 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:51.441 19:28:38 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:51.441 19:28:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:21:51.441 19:28:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.441 19:28:38 -- host/auth.sh@68 -- # digest=sha384 00:21:51.441 19:28:38 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:51.441 19:28:38 -- host/auth.sh@68 -- # keyid=2 00:21:51.441 19:28:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:21:51.441 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.441 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.441 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.441 19:28:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.441 19:28:38 -- nvmf/common.sh@717 -- # local ip 00:21:51.441 19:28:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.441 19:28:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.441 19:28:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.441 19:28:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.441 19:28:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.441 19:28:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.441 19:28:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.441 19:28:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.441 19:28:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.441 19:28:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:51.441 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.441 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.699 nvme0n1 00:21:51.699 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.699 19:28:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.699 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.699 19:28:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.699 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.699 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.699 19:28:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.699 19:28:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.699 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.699 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.957 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.957 19:28:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.957 19:28:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:21:51.957 19:28:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.957 19:28:38 -- host/auth.sh@44 -- # digest=sha384 00:21:51.957 19:28:38 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:51.957 19:28:38 -- host/auth.sh@44 -- # keyid=3 00:21:51.957 19:28:38 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:51.957 19:28:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:51.957 19:28:38 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:51.957 19:28:38 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:51.957 19:28:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:21:51.957 19:28:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.957 19:28:38 -- host/auth.sh@68 -- # digest=sha384 00:21:51.957 19:28:38 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:51.957 19:28:38 -- host/auth.sh@68 -- # keyid=3 00:21:51.957 19:28:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:21:51.957 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.957 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.957 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.957 19:28:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.957 19:28:38 -- nvmf/common.sh@717 -- # local ip 00:21:51.957 19:28:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.957 19:28:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.957 19:28:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.957 19:28:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.957 19:28:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.957 19:28:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.957 19:28:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.957 19:28:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.957 19:28:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.957 19:28:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:51.957 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.957 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.957 nvme0n1 00:21:51.957 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.957 19:28:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.957 19:28:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.957 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.957 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:51.957 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:51.957 19:28:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.957 19:28:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.957 19:28:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:51.957 19:28:38 -- common/autotest_common.sh@10 -- # set +x 00:21:52.216 19:28:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.216 19:28:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.216 19:28:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:21:52.216 19:28:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.216 19:28:39 -- host/auth.sh@44 -- # digest=sha384 00:21:52.216 19:28:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:52.216 19:28:39 -- host/auth.sh@44 -- # keyid=4 00:21:52.216 19:28:39 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:52.216 19:28:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:52.216 19:28:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:52.216 19:28:39 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:52.216 19:28:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:21:52.216 19:28:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.216 19:28:39 -- host/auth.sh@68 -- # digest=sha384 00:21:52.216 19:28:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:52.216 19:28:39 -- host/auth.sh@68 -- # keyid=4 00:21:52.216 19:28:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:21:52.216 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.216 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.216 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.216 19:28:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.216 19:28:39 -- nvmf/common.sh@717 -- # local ip 00:21:52.216 19:28:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.216 19:28:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.216 19:28:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.216 19:28:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.216 19:28:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.216 19:28:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.216 19:28:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.216 19:28:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.216 19:28:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.216 19:28:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:52.216 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.216 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.216 nvme0n1 00:21:52.216 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.216 19:28:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.216 19:28:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.216 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.216 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.474 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.474 19:28:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.474 19:28:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.474 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.474 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.474 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.474 19:28:39 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:52.474 19:28:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.474 19:28:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:21:52.474 19:28:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.474 19:28:39 -- host/auth.sh@44 -- # digest=sha384 00:21:52.474 19:28:39 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.474 19:28:39 -- host/auth.sh@44 -- # keyid=0 00:21:52.474 19:28:39 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:52.474 19:28:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:52.474 19:28:39 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.474 19:28:39 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:52.474 19:28:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:21:52.474 19:28:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.474 19:28:39 -- host/auth.sh@68 -- # digest=sha384 00:21:52.474 19:28:39 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.474 19:28:39 -- host/auth.sh@68 -- # keyid=0 00:21:52.474 19:28:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:21:52.474 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.474 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.474 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.474 19:28:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.474 19:28:39 -- nvmf/common.sh@717 -- # local ip 00:21:52.474 19:28:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.474 19:28:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.474 19:28:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.474 19:28:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.474 19:28:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.474 19:28:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.474 19:28:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.474 19:28:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.475 19:28:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.475 19:28:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:52.475 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.475 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.733 nvme0n1 00:21:52.733 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.733 19:28:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.733 19:28:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.733 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.733 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.733 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.733 19:28:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.733 19:28:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.733 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.733 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.733 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.733 19:28:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.733 19:28:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:21:52.733 19:28:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.733 19:28:39 -- host/auth.sh@44 -- # digest=sha384 00:21:52.733 19:28:39 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.733 19:28:39 -- host/auth.sh@44 -- # keyid=1 00:21:52.733 19:28:39 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:52.733 19:28:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:52.733 19:28:39 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.733 19:28:39 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:52.733 19:28:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:21:52.733 19:28:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.733 19:28:39 -- host/auth.sh@68 -- # digest=sha384 00:21:52.733 19:28:39 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.733 19:28:39 -- host/auth.sh@68 -- # keyid=1 00:21:52.733 19:28:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:21:52.733 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.733 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.733 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.733 19:28:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.733 19:28:39 -- nvmf/common.sh@717 -- # local ip 00:21:52.733 19:28:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.733 19:28:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.733 19:28:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.733 19:28:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.733 19:28:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.733 19:28:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.733 19:28:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.733 19:28:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.733 19:28:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.733 19:28:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:52.733 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.733 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.991 nvme0n1 00:21:52.991 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.991 19:28:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.991 19:28:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.991 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.991 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.991 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.991 19:28:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.991 19:28:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.991 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.991 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.991 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.991 19:28:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.991 19:28:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:21:52.991 19:28:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.991 19:28:39 -- host/auth.sh@44 -- # digest=sha384 00:21:52.991 19:28:39 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.991 19:28:39 -- host/auth.sh@44 -- # keyid=2 00:21:52.991 19:28:39 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:52.991 19:28:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:52.991 19:28:39 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.991 19:28:39 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:52.991 19:28:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:21:52.991 19:28:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.991 19:28:39 -- host/auth.sh@68 -- # digest=sha384 00:21:52.991 19:28:39 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.991 19:28:39 -- host/auth.sh@68 -- # keyid=2 00:21:52.991 19:28:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:21:52.991 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.991 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:52.991 19:28:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:52.991 19:28:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.991 19:28:39 -- nvmf/common.sh@717 -- # local ip 00:21:52.991 19:28:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.991 19:28:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.991 19:28:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.991 19:28:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.991 19:28:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.991 19:28:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.991 19:28:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.991 19:28:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.991 19:28:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.991 19:28:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:52.991 19:28:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:52.991 19:28:39 -- common/autotest_common.sh@10 -- # set +x 00:21:53.249 nvme0n1 00:21:53.249 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.249 19:28:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:53.249 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.249 19:28:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:53.249 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.249 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.507 19:28:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:53.507 19:28:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:53.507 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.507 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.507 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.507 19:28:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:53.507 19:28:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:21:53.507 19:28:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:53.507 19:28:40 -- host/auth.sh@44 -- # digest=sha384 00:21:53.508 19:28:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:53.508 19:28:40 -- host/auth.sh@44 -- # keyid=3 00:21:53.508 19:28:40 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:53.508 19:28:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:53.508 19:28:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:53.508 19:28:40 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:53.508 19:28:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:21:53.508 19:28:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:53.508 19:28:40 -- host/auth.sh@68 -- # digest=sha384 00:21:53.508 19:28:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:53.508 19:28:40 -- host/auth.sh@68 -- # keyid=3 00:21:53.508 19:28:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:21:53.508 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.508 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.508 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.508 19:28:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:53.508 19:28:40 -- nvmf/common.sh@717 -- # local ip 00:21:53.508 19:28:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:53.508 19:28:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:53.508 19:28:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:53.508 19:28:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:53.508 19:28:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:53.508 19:28:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:53.508 19:28:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:53.508 19:28:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:53.508 19:28:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:53.508 19:28:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:53.508 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.508 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.766 nvme0n1 00:21:53.766 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.766 19:28:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:53.766 19:28:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:53.766 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.766 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.766 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.767 19:28:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:53.767 19:28:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:53.767 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.767 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.767 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.767 19:28:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:53.767 19:28:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:21:53.767 19:28:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:53.767 19:28:40 -- host/auth.sh@44 -- # digest=sha384 00:21:53.767 19:28:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:53.767 19:28:40 -- host/auth.sh@44 -- # keyid=4 00:21:53.767 19:28:40 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:53.767 19:28:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:53.767 19:28:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:53.767 19:28:40 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:53.767 19:28:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:21:53.767 19:28:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:53.767 19:28:40 -- host/auth.sh@68 -- # digest=sha384 00:21:53.767 19:28:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:53.767 19:28:40 -- host/auth.sh@68 -- # keyid=4 00:21:53.767 19:28:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:21:53.767 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.767 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:53.767 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:53.767 19:28:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:53.767 19:28:40 -- nvmf/common.sh@717 -- # local ip 00:21:53.767 19:28:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:53.767 19:28:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:53.767 19:28:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:53.767 19:28:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:53.767 19:28:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:53.767 19:28:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:53.767 19:28:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:53.767 19:28:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:53.767 19:28:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:53.767 19:28:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:53.767 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:53.767 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:54.026 nvme0n1 00:21:54.026 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.026 19:28:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.026 19:28:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.026 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.026 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:54.026 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.026 19:28:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.026 19:28:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.026 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.026 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:54.026 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.026 19:28:40 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:54.026 19:28:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:54.026 19:28:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:21:54.026 19:28:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:54.026 19:28:40 -- host/auth.sh@44 -- # digest=sha384 00:21:54.026 19:28:40 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:54.026 19:28:40 -- host/auth.sh@44 -- # keyid=0 00:21:54.026 19:28:40 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:54.026 19:28:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:54.026 19:28:40 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:54.026 19:28:40 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:54.026 19:28:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:21:54.026 19:28:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:54.026 19:28:40 -- host/auth.sh@68 -- # digest=sha384 00:21:54.026 19:28:40 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:54.026 19:28:40 -- host/auth.sh@68 -- # keyid=0 00:21:54.026 19:28:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:21:54.026 19:28:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.026 19:28:40 -- common/autotest_common.sh@10 -- # set +x 00:21:54.026 19:28:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.026 19:28:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:54.026 19:28:40 -- nvmf/common.sh@717 -- # local ip 00:21:54.026 19:28:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:54.026 19:28:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:54.026 19:28:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:54.026 19:28:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:54.026 19:28:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:54.026 19:28:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:54.026 19:28:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:54.026 19:28:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:54.026 19:28:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:54.026 19:28:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:54.026 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.026 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.593 nvme0n1 00:21:54.593 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.593 19:28:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.593 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.593 19:28:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.593 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.593 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.593 19:28:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.593 19:28:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.593 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.593 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.593 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.593 19:28:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:54.593 19:28:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:21:54.593 19:28:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:54.593 19:28:41 -- host/auth.sh@44 -- # digest=sha384 00:21:54.593 19:28:41 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:54.593 19:28:41 -- host/auth.sh@44 -- # keyid=1 00:21:54.593 19:28:41 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:54.593 19:28:41 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:54.593 19:28:41 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:54.593 19:28:41 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:54.593 19:28:41 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:21:54.593 19:28:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:54.593 19:28:41 -- host/auth.sh@68 -- # digest=sha384 00:21:54.593 19:28:41 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:54.593 19:28:41 -- host/auth.sh@68 -- # keyid=1 00:21:54.593 19:28:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:21:54.593 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.593 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.593 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.593 19:28:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:54.593 19:28:41 -- nvmf/common.sh@717 -- # local ip 00:21:54.593 19:28:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:54.593 19:28:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:54.593 19:28:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:54.593 19:28:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:54.593 19:28:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:54.593 19:28:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:54.593 19:28:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:54.593 19:28:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:54.593 19:28:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:54.593 19:28:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:54.593 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.593 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.852 nvme0n1 00:21:54.852 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.852 19:28:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.852 19:28:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.852 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.852 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:54.852 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:54.852 19:28:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.852 19:28:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.852 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:54.852 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:55.111 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.111 19:28:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:55.111 19:28:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:21:55.111 19:28:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:55.111 19:28:41 -- host/auth.sh@44 -- # digest=sha384 00:21:55.111 19:28:41 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:55.111 19:28:41 -- host/auth.sh@44 -- # keyid=2 00:21:55.111 19:28:41 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:55.111 19:28:41 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:55.111 19:28:41 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:55.111 19:28:41 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:55.111 19:28:41 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:21:55.111 19:28:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:55.111 19:28:41 -- host/auth.sh@68 -- # digest=sha384 00:21:55.111 19:28:41 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:55.111 19:28:41 -- host/auth.sh@68 -- # keyid=2 00:21:55.111 19:28:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:21:55.111 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.111 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:55.111 19:28:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.111 19:28:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:55.111 19:28:41 -- nvmf/common.sh@717 -- # local ip 00:21:55.111 19:28:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:55.111 19:28:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:55.111 19:28:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:55.111 19:28:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:55.111 19:28:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:55.111 19:28:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:55.111 19:28:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:55.111 19:28:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:55.111 19:28:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:55.111 19:28:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:55.111 19:28:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.111 19:28:41 -- common/autotest_common.sh@10 -- # set +x 00:21:55.370 nvme0n1 00:21:55.370 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.370 19:28:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:55.370 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.370 19:28:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:55.370 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.370 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.370 19:28:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:55.370 19:28:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:55.370 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.370 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.370 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.370 19:28:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:55.370 19:28:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:21:55.370 19:28:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:55.370 19:28:42 -- host/auth.sh@44 -- # digest=sha384 00:21:55.370 19:28:42 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:55.370 19:28:42 -- host/auth.sh@44 -- # keyid=3 00:21:55.370 19:28:42 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:55.370 19:28:42 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:55.370 19:28:42 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:55.370 19:28:42 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:55.370 19:28:42 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:21:55.370 19:28:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:55.370 19:28:42 -- host/auth.sh@68 -- # digest=sha384 00:21:55.370 19:28:42 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:55.370 19:28:42 -- host/auth.sh@68 -- # keyid=3 00:21:55.370 19:28:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:21:55.370 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.370 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.370 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.370 19:28:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:55.370 19:28:42 -- nvmf/common.sh@717 -- # local ip 00:21:55.371 19:28:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:55.371 19:28:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:55.371 19:28:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:55.371 19:28:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:55.371 19:28:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:55.371 19:28:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:55.371 19:28:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:55.371 19:28:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:55.371 19:28:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:55.371 19:28:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:55.371 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.371 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.938 nvme0n1 00:21:55.938 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.938 19:28:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:55.938 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.938 19:28:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:55.938 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.938 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.938 19:28:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:55.938 19:28:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:55.938 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.938 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.938 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.938 19:28:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:55.938 19:28:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:21:55.938 19:28:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:55.938 19:28:42 -- host/auth.sh@44 -- # digest=sha384 00:21:55.938 19:28:42 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:55.938 19:28:42 -- host/auth.sh@44 -- # keyid=4 00:21:55.938 19:28:42 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:55.938 19:28:42 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:55.938 19:28:42 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:55.938 19:28:42 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:55.938 19:28:42 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:21:55.938 19:28:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:55.938 19:28:42 -- host/auth.sh@68 -- # digest=sha384 00:21:55.938 19:28:42 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:55.938 19:28:42 -- host/auth.sh@68 -- # keyid=4 00:21:55.938 19:28:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:21:55.938 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.938 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:55.938 19:28:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.938 19:28:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:55.938 19:28:42 -- nvmf/common.sh@717 -- # local ip 00:21:55.938 19:28:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:55.938 19:28:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:55.938 19:28:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:55.938 19:28:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:55.938 19:28:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:55.938 19:28:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:55.938 19:28:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:55.938 19:28:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:55.938 19:28:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:55.938 19:28:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:55.938 19:28:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.938 19:28:42 -- common/autotest_common.sh@10 -- # set +x 00:21:56.197 nvme0n1 00:21:56.197 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:56.197 19:28:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:56.197 19:28:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:56.197 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:56.197 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:56.197 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:56.197 19:28:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:56.197 19:28:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:56.197 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:56.197 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:56.455 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:56.455 19:28:43 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:56.455 19:28:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:56.455 19:28:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:21:56.455 19:28:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:56.455 19:28:43 -- host/auth.sh@44 -- # digest=sha384 00:21:56.455 19:28:43 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:56.455 19:28:43 -- host/auth.sh@44 -- # keyid=0 00:21:56.455 19:28:43 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:56.455 19:28:43 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:56.455 19:28:43 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:56.455 19:28:43 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:56.455 19:28:43 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:21:56.455 19:28:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:56.455 19:28:43 -- host/auth.sh@68 -- # digest=sha384 00:21:56.455 19:28:43 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:56.455 19:28:43 -- host/auth.sh@68 -- # keyid=0 00:21:56.455 19:28:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:21:56.455 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:56.455 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:56.455 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:56.455 19:28:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:56.455 19:28:43 -- nvmf/common.sh@717 -- # local ip 00:21:56.455 19:28:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:56.455 19:28:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:56.455 19:28:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:56.455 19:28:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:56.455 19:28:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:56.455 19:28:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:56.455 19:28:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:56.455 19:28:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:56.455 19:28:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:56.455 19:28:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:56.456 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:56.456 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:57.022 nvme0n1 00:21:57.022 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.022 19:28:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:57.022 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.022 19:28:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:57.022 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:57.022 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.022 19:28:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:57.022 19:28:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:57.022 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.022 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:57.022 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.022 19:28:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:57.022 19:28:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:21:57.022 19:28:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:57.022 19:28:43 -- host/auth.sh@44 -- # digest=sha384 00:21:57.022 19:28:43 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:57.022 19:28:43 -- host/auth.sh@44 -- # keyid=1 00:21:57.022 19:28:43 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:57.022 19:28:43 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:57.022 19:28:43 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:57.022 19:28:43 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:57.023 19:28:43 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:21:57.023 19:28:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:57.023 19:28:43 -- host/auth.sh@68 -- # digest=sha384 00:21:57.023 19:28:43 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:57.023 19:28:43 -- host/auth.sh@68 -- # keyid=1 00:21:57.023 19:28:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:21:57.023 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.023 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:57.023 19:28:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.023 19:28:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:57.023 19:28:43 -- nvmf/common.sh@717 -- # local ip 00:21:57.023 19:28:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:57.023 19:28:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:57.023 19:28:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:57.023 19:28:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:57.023 19:28:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:57.023 19:28:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:57.023 19:28:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:57.023 19:28:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:57.023 19:28:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:57.023 19:28:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:57.023 19:28:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.023 19:28:43 -- common/autotest_common.sh@10 -- # set +x 00:21:57.589 nvme0n1 00:21:57.589 19:28:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.589 19:28:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:57.589 19:28:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:57.589 19:28:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.589 19:28:44 -- common/autotest_common.sh@10 -- # set +x 00:21:57.589 19:28:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.589 19:28:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:57.589 19:28:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:57.589 19:28:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.589 19:28:44 -- common/autotest_common.sh@10 -- # set +x 00:21:57.589 19:28:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.589 19:28:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:57.589 19:28:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:21:57.589 19:28:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:57.589 19:28:44 -- host/auth.sh@44 -- # digest=sha384 00:21:57.589 19:28:44 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:57.589 19:28:44 -- host/auth.sh@44 -- # keyid=2 00:21:57.589 19:28:44 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:57.589 19:28:44 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:57.589 19:28:44 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:57.589 19:28:44 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:21:57.589 19:28:44 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:21:57.589 19:28:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:57.589 19:28:44 -- host/auth.sh@68 -- # digest=sha384 00:21:57.589 19:28:44 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:57.589 19:28:44 -- host/auth.sh@68 -- # keyid=2 00:21:57.589 19:28:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:21:57.589 19:28:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.589 19:28:44 -- common/autotest_common.sh@10 -- # set +x 00:21:57.589 19:28:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:57.589 19:28:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:57.589 19:28:44 -- nvmf/common.sh@717 -- # local ip 00:21:57.589 19:28:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:57.589 19:28:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:57.589 19:28:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:57.589 19:28:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:57.589 19:28:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:57.589 19:28:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:57.589 19:28:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:57.589 19:28:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:57.589 19:28:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:57.589 19:28:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:57.589 19:28:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:57.589 19:28:44 -- common/autotest_common.sh@10 -- # set +x 00:21:58.156 nvme0n1 00:21:58.156 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.156 19:28:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:58.156 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.156 19:28:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:58.156 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.156 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.156 19:28:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:58.156 19:28:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:58.156 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.156 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.156 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.156 19:28:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:58.156 19:28:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:21:58.156 19:28:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:58.156 19:28:45 -- host/auth.sh@44 -- # digest=sha384 00:21:58.156 19:28:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:58.156 19:28:45 -- host/auth.sh@44 -- # keyid=3 00:21:58.156 19:28:45 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:58.156 19:28:45 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:58.156 19:28:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:58.156 19:28:45 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:21:58.156 19:28:45 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:21:58.156 19:28:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:58.156 19:28:45 -- host/auth.sh@68 -- # digest=sha384 00:21:58.156 19:28:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:58.156 19:28:45 -- host/auth.sh@68 -- # keyid=3 00:21:58.156 19:28:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:21:58.156 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.156 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.156 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.156 19:28:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:58.156 19:28:45 -- nvmf/common.sh@717 -- # local ip 00:21:58.156 19:28:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:58.156 19:28:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:58.156 19:28:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:58.156 19:28:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:58.156 19:28:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:58.156 19:28:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:58.156 19:28:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:58.157 19:28:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:58.157 19:28:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:58.157 19:28:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:58.157 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.157 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.722 nvme0n1 00:21:58.722 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.722 19:28:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:58.722 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.722 19:28:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:58.722 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.723 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.981 19:28:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:58.981 19:28:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:58.981 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.981 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.981 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.981 19:28:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:58.981 19:28:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:21:58.981 19:28:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:58.981 19:28:45 -- host/auth.sh@44 -- # digest=sha384 00:21:58.981 19:28:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:58.981 19:28:45 -- host/auth.sh@44 -- # keyid=4 00:21:58.981 19:28:45 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:58.981 19:28:45 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:58.981 19:28:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:58.981 19:28:45 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:21:58.981 19:28:45 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:21:58.981 19:28:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:58.981 19:28:45 -- host/auth.sh@68 -- # digest=sha384 00:21:58.981 19:28:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:58.981 19:28:45 -- host/auth.sh@68 -- # keyid=4 00:21:58.981 19:28:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:21:58.981 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.981 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:58.981 19:28:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:58.981 19:28:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:58.981 19:28:45 -- nvmf/common.sh@717 -- # local ip 00:21:58.981 19:28:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:58.981 19:28:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:58.981 19:28:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:58.981 19:28:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:58.981 19:28:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:58.981 19:28:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:58.981 19:28:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:58.981 19:28:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:58.981 19:28:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:58.981 19:28:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:58.981 19:28:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:58.981 19:28:45 -- common/autotest_common.sh@10 -- # set +x 00:21:59.549 nvme0n1 00:21:59.549 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.549 19:28:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.549 19:28:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.549 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.549 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.549 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.549 19:28:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.549 19:28:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.549 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.549 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.549 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.549 19:28:46 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:21:59.549 19:28:46 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:59.549 19:28:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.549 19:28:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:21:59.549 19:28:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.549 19:28:46 -- host/auth.sh@44 -- # digest=sha512 00:21:59.549 19:28:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.549 19:28:46 -- host/auth.sh@44 -- # keyid=0 00:21:59.549 19:28:46 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:59.549 19:28:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:21:59.549 19:28:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.549 19:28:46 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:21:59.549 19:28:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:21:59.549 19:28:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.549 19:28:46 -- host/auth.sh@68 -- # digest=sha512 00:21:59.549 19:28:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.549 19:28:46 -- host/auth.sh@68 -- # keyid=0 00:21:59.549 19:28:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:21:59.549 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.549 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.549 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.549 19:28:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.549 19:28:46 -- nvmf/common.sh@717 -- # local ip 00:21:59.549 19:28:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.549 19:28:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.549 19:28:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.549 19:28:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.549 19:28:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.549 19:28:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.549 19:28:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.549 19:28:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.549 19:28:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.549 19:28:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:59.549 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.549 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.808 nvme0n1 00:21:59.808 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.809 19:28:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.809 19:28:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.809 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.809 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.809 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.809 19:28:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.809 19:28:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.809 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.809 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.809 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.809 19:28:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.809 19:28:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:21:59.809 19:28:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.809 19:28:46 -- host/auth.sh@44 -- # digest=sha512 00:21:59.809 19:28:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.809 19:28:46 -- host/auth.sh@44 -- # keyid=1 00:21:59.809 19:28:46 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:59.809 19:28:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:21:59.809 19:28:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.809 19:28:46 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:21:59.809 19:28:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:21:59.809 19:28:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.809 19:28:46 -- host/auth.sh@68 -- # digest=sha512 00:21:59.809 19:28:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.809 19:28:46 -- host/auth.sh@68 -- # keyid=1 00:21:59.809 19:28:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:21:59.809 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.809 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:21:59.809 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:59.809 19:28:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.809 19:28:46 -- nvmf/common.sh@717 -- # local ip 00:21:59.809 19:28:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.809 19:28:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.809 19:28:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.809 19:28:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.809 19:28:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.809 19:28:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.809 19:28:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.809 19:28:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.809 19:28:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.809 19:28:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:59.809 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:59.809 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:22:00.068 nvme0n1 00:22:00.068 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.068 19:28:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.068 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.068 19:28:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.068 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:22:00.068 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.068 19:28:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.068 19:28:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.068 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.068 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:22:00.068 19:28:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.068 19:28:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.068 19:28:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:22:00.068 19:28:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.068 19:28:46 -- host/auth.sh@44 -- # digest=sha512 00:22:00.068 19:28:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:00.068 19:28:46 -- host/auth.sh@44 -- # keyid=2 00:22:00.068 19:28:46 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:00.068 19:28:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:00.068 19:28:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:00.068 19:28:46 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:00.068 19:28:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:22:00.068 19:28:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.068 19:28:46 -- host/auth.sh@68 -- # digest=sha512 00:22:00.068 19:28:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:00.068 19:28:46 -- host/auth.sh@68 -- # keyid=2 00:22:00.068 19:28:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:00.068 19:28:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.068 19:28:46 -- common/autotest_common.sh@10 -- # set +x 00:22:00.068 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.068 19:28:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.068 19:28:47 -- nvmf/common.sh@717 -- # local ip 00:22:00.068 19:28:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.068 19:28:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.068 19:28:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.068 19:28:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.068 19:28:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.068 19:28:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.068 19:28:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.068 19:28:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.068 19:28:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.068 19:28:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:00.068 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.068 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.361 nvme0n1 00:22:00.361 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.361 19:28:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.361 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.361 19:28:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.361 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.361 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.361 19:28:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.361 19:28:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.361 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.361 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.361 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.361 19:28:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.361 19:28:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:22:00.361 19:28:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.361 19:28:47 -- host/auth.sh@44 -- # digest=sha512 00:22:00.361 19:28:47 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:00.361 19:28:47 -- host/auth.sh@44 -- # keyid=3 00:22:00.361 19:28:47 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:00.361 19:28:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:00.361 19:28:47 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:00.361 19:28:47 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:00.361 19:28:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:22:00.361 19:28:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.361 19:28:47 -- host/auth.sh@68 -- # digest=sha512 00:22:00.361 19:28:47 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:00.361 19:28:47 -- host/auth.sh@68 -- # keyid=3 00:22:00.361 19:28:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:00.361 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.361 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.361 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.361 19:28:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.361 19:28:47 -- nvmf/common.sh@717 -- # local ip 00:22:00.361 19:28:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.361 19:28:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.361 19:28:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.361 19:28:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.361 19:28:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.361 19:28:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.361 19:28:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.361 19:28:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.361 19:28:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.361 19:28:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:00.361 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.361 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.640 nvme0n1 00:22:00.640 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.640 19:28:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.640 19:28:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.640 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.640 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.640 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.640 19:28:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.640 19:28:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.640 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.640 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.640 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.640 19:28:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.640 19:28:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:22:00.640 19:28:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.640 19:28:47 -- host/auth.sh@44 -- # digest=sha512 00:22:00.640 19:28:47 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:00.640 19:28:47 -- host/auth.sh@44 -- # keyid=4 00:22:00.640 19:28:47 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:00.640 19:28:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:00.640 19:28:47 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:00.640 19:28:47 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:00.640 19:28:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:22:00.640 19:28:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.640 19:28:47 -- host/auth.sh@68 -- # digest=sha512 00:22:00.640 19:28:47 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:00.640 19:28:47 -- host/auth.sh@68 -- # keyid=4 00:22:00.640 19:28:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:00.640 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.640 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.640 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.640 19:28:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.640 19:28:47 -- nvmf/common.sh@717 -- # local ip 00:22:00.640 19:28:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.640 19:28:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.640 19:28:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.640 19:28:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.640 19:28:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.640 19:28:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.640 19:28:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.640 19:28:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.640 19:28:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.640 19:28:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:00.640 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.640 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.900 nvme0n1 00:22:00.900 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.900 19:28:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.900 19:28:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.900 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.900 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.900 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.900 19:28:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.900 19:28:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.900 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.900 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.900 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.900 19:28:47 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:00.900 19:28:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.900 19:28:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:22:00.900 19:28:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.900 19:28:47 -- host/auth.sh@44 -- # digest=sha512 00:22:00.900 19:28:47 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:00.900 19:28:47 -- host/auth.sh@44 -- # keyid=0 00:22:00.900 19:28:47 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:00.900 19:28:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:00.900 19:28:47 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:00.900 19:28:47 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:00.900 19:28:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:22:00.900 19:28:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.900 19:28:47 -- host/auth.sh@68 -- # digest=sha512 00:22:00.900 19:28:47 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:00.900 19:28:47 -- host/auth.sh@68 -- # keyid=0 00:22:00.900 19:28:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:00.900 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.900 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:00.900 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:00.900 19:28:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.900 19:28:47 -- nvmf/common.sh@717 -- # local ip 00:22:00.900 19:28:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.900 19:28:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.900 19:28:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.900 19:28:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.900 19:28:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.900 19:28:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.900 19:28:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.900 19:28:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.900 19:28:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.900 19:28:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:00.900 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:00.900 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:01.160 nvme0n1 00:22:01.160 19:28:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.160 19:28:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.160 19:28:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.160 19:28:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.160 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:01.160 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.160 19:28:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.160 19:28:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.160 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.160 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.160 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.160 19:28:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.160 19:28:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:22:01.160 19:28:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.160 19:28:48 -- host/auth.sh@44 -- # digest=sha512 00:22:01.160 19:28:48 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:01.160 19:28:48 -- host/auth.sh@44 -- # keyid=1 00:22:01.160 19:28:48 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:01.160 19:28:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:01.160 19:28:48 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:01.160 19:28:48 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:01.160 19:28:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:22:01.160 19:28:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.160 19:28:48 -- host/auth.sh@68 -- # digest=sha512 00:22:01.160 19:28:48 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:01.160 19:28:48 -- host/auth.sh@68 -- # keyid=1 00:22:01.160 19:28:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:01.160 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.160 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.160 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.160 19:28:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.160 19:28:48 -- nvmf/common.sh@717 -- # local ip 00:22:01.160 19:28:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.160 19:28:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.160 19:28:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.160 19:28:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.160 19:28:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.160 19:28:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.160 19:28:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.160 19:28:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.160 19:28:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.160 19:28:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:01.160 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.160 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.419 nvme0n1 00:22:01.419 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.419 19:28:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.419 19:28:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.419 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.419 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.419 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.419 19:28:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.419 19:28:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.419 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.419 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.419 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.419 19:28:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.419 19:28:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:22:01.419 19:28:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.419 19:28:48 -- host/auth.sh@44 -- # digest=sha512 00:22:01.419 19:28:48 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:01.419 19:28:48 -- host/auth.sh@44 -- # keyid=2 00:22:01.419 19:28:48 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:01.419 19:28:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:01.419 19:28:48 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:01.419 19:28:48 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:01.419 19:28:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:22:01.419 19:28:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.419 19:28:48 -- host/auth.sh@68 -- # digest=sha512 00:22:01.419 19:28:48 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:01.419 19:28:48 -- host/auth.sh@68 -- # keyid=2 00:22:01.419 19:28:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:01.419 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.419 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.419 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.419 19:28:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.419 19:28:48 -- nvmf/common.sh@717 -- # local ip 00:22:01.419 19:28:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.419 19:28:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.419 19:28:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.419 19:28:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.419 19:28:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.419 19:28:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.419 19:28:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.419 19:28:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.419 19:28:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.419 19:28:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:01.420 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.420 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.679 nvme0n1 00:22:01.679 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.679 19:28:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.679 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.679 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.679 19:28:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.679 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.679 19:28:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.679 19:28:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.679 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.679 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.679 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.679 19:28:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.679 19:28:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:22:01.679 19:28:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.679 19:28:48 -- host/auth.sh@44 -- # digest=sha512 00:22:01.679 19:28:48 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:01.679 19:28:48 -- host/auth.sh@44 -- # keyid=3 00:22:01.679 19:28:48 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:01.679 19:28:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:01.679 19:28:48 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:01.679 19:28:48 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:01.679 19:28:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:22:01.679 19:28:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.679 19:28:48 -- host/auth.sh@68 -- # digest=sha512 00:22:01.679 19:28:48 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:01.679 19:28:48 -- host/auth.sh@68 -- # keyid=3 00:22:01.679 19:28:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:01.679 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.679 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.679 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.679 19:28:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.679 19:28:48 -- nvmf/common.sh@717 -- # local ip 00:22:01.679 19:28:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.679 19:28:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.679 19:28:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.679 19:28:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.679 19:28:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.679 19:28:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.679 19:28:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.679 19:28:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.679 19:28:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.679 19:28:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:01.679 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.679 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.938 nvme0n1 00:22:01.939 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.939 19:28:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.939 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.939 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.939 19:28:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.939 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.939 19:28:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.939 19:28:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.939 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.939 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.939 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.939 19:28:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.939 19:28:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:22:01.939 19:28:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.939 19:28:48 -- host/auth.sh@44 -- # digest=sha512 00:22:01.939 19:28:48 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:01.939 19:28:48 -- host/auth.sh@44 -- # keyid=4 00:22:01.939 19:28:48 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:01.939 19:28:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:01.939 19:28:48 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:01.939 19:28:48 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:01.939 19:28:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:22:01.939 19:28:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.939 19:28:48 -- host/auth.sh@68 -- # digest=sha512 00:22:01.939 19:28:48 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:01.939 19:28:48 -- host/auth.sh@68 -- # keyid=4 00:22:01.939 19:28:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:01.939 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.939 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:01.939 19:28:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.939 19:28:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.939 19:28:48 -- nvmf/common.sh@717 -- # local ip 00:22:01.939 19:28:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.939 19:28:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.939 19:28:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.939 19:28:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.939 19:28:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.939 19:28:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.939 19:28:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.939 19:28:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.939 19:28:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.939 19:28:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:01.939 19:28:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.939 19:28:48 -- common/autotest_common.sh@10 -- # set +x 00:22:02.197 nvme0n1 00:22:02.198 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.198 19:28:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.198 19:28:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.198 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.198 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.198 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.198 19:28:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.198 19:28:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.198 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.198 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.198 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.198 19:28:49 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:02.198 19:28:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.198 19:28:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:22:02.198 19:28:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.198 19:28:49 -- host/auth.sh@44 -- # digest=sha512 00:22:02.198 19:28:49 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.198 19:28:49 -- host/auth.sh@44 -- # keyid=0 00:22:02.198 19:28:49 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:02.198 19:28:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:02.198 19:28:49 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.198 19:28:49 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:02.198 19:28:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:22:02.198 19:28:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.198 19:28:49 -- host/auth.sh@68 -- # digest=sha512 00:22:02.198 19:28:49 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.198 19:28:49 -- host/auth.sh@68 -- # keyid=0 00:22:02.198 19:28:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:02.198 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.198 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.198 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.198 19:28:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.198 19:28:49 -- nvmf/common.sh@717 -- # local ip 00:22:02.198 19:28:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.198 19:28:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.198 19:28:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.198 19:28:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.198 19:28:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.198 19:28:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.198 19:28:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.198 19:28:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.198 19:28:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.198 19:28:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:02.198 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.198 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.457 nvme0n1 00:22:02.457 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.457 19:28:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.457 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.457 19:28:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.457 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.457 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.457 19:28:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.457 19:28:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.457 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.457 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.457 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.457 19:28:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.457 19:28:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:22:02.457 19:28:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.457 19:28:49 -- host/auth.sh@44 -- # digest=sha512 00:22:02.457 19:28:49 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.457 19:28:49 -- host/auth.sh@44 -- # keyid=1 00:22:02.457 19:28:49 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:02.457 19:28:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:02.457 19:28:49 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.457 19:28:49 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:02.457 19:28:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:22:02.457 19:28:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.457 19:28:49 -- host/auth.sh@68 -- # digest=sha512 00:22:02.457 19:28:49 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.457 19:28:49 -- host/auth.sh@68 -- # keyid=1 00:22:02.457 19:28:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:02.457 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.457 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.457 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.457 19:28:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.457 19:28:49 -- nvmf/common.sh@717 -- # local ip 00:22:02.457 19:28:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.457 19:28:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.457 19:28:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.457 19:28:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.457 19:28:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.457 19:28:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.457 19:28:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.457 19:28:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.457 19:28:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.457 19:28:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:02.457 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.457 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.716 nvme0n1 00:22:02.716 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.716 19:28:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.716 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.716 19:28:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.716 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.716 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.976 19:28:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.976 19:28:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.976 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.976 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.976 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.976 19:28:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.976 19:28:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:22:02.976 19:28:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.976 19:28:49 -- host/auth.sh@44 -- # digest=sha512 00:22:02.976 19:28:49 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.976 19:28:49 -- host/auth.sh@44 -- # keyid=2 00:22:02.976 19:28:49 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:02.976 19:28:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:02.976 19:28:49 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.976 19:28:49 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:02.976 19:28:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:22:02.976 19:28:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.976 19:28:49 -- host/auth.sh@68 -- # digest=sha512 00:22:02.976 19:28:49 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.976 19:28:49 -- host/auth.sh@68 -- # keyid=2 00:22:02.976 19:28:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:02.976 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.976 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:02.976 19:28:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:02.976 19:28:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.976 19:28:49 -- nvmf/common.sh@717 -- # local ip 00:22:02.976 19:28:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.976 19:28:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.976 19:28:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.976 19:28:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.976 19:28:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.976 19:28:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.976 19:28:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.976 19:28:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.976 19:28:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.976 19:28:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:02.976 19:28:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:02.976 19:28:49 -- common/autotest_common.sh@10 -- # set +x 00:22:03.235 nvme0n1 00:22:03.235 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.235 19:28:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:03.235 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.235 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.235 19:28:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:03.235 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.235 19:28:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.235 19:28:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.235 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.235 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.235 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.235 19:28:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.235 19:28:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:22:03.235 19:28:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.235 19:28:50 -- host/auth.sh@44 -- # digest=sha512 00:22:03.235 19:28:50 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:03.235 19:28:50 -- host/auth.sh@44 -- # keyid=3 00:22:03.235 19:28:50 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:03.235 19:28:50 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:03.235 19:28:50 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:03.235 19:28:50 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:03.235 19:28:50 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:22:03.235 19:28:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.235 19:28:50 -- host/auth.sh@68 -- # digest=sha512 00:22:03.235 19:28:50 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:03.235 19:28:50 -- host/auth.sh@68 -- # keyid=3 00:22:03.235 19:28:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:03.235 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.235 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.235 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.235 19:28:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:03.235 19:28:50 -- nvmf/common.sh@717 -- # local ip 00:22:03.235 19:28:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:03.235 19:28:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:03.235 19:28:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:03.235 19:28:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:03.235 19:28:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:03.235 19:28:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:03.235 19:28:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:03.235 19:28:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:03.235 19:28:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:03.235 19:28:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:03.235 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.235 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.495 nvme0n1 00:22:03.495 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.495 19:28:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:03.495 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.495 19:28:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:03.495 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.495 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.495 19:28:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.495 19:28:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.495 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.495 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.495 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.495 19:28:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.495 19:28:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:22:03.495 19:28:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.495 19:28:50 -- host/auth.sh@44 -- # digest=sha512 00:22:03.495 19:28:50 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:03.495 19:28:50 -- host/auth.sh@44 -- # keyid=4 00:22:03.495 19:28:50 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:03.495 19:28:50 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:03.495 19:28:50 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:03.495 19:28:50 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:03.495 19:28:50 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:22:03.495 19:28:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.495 19:28:50 -- host/auth.sh@68 -- # digest=sha512 00:22:03.495 19:28:50 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:03.495 19:28:50 -- host/auth.sh@68 -- # keyid=4 00:22:03.495 19:28:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:03.495 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.495 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.495 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.495 19:28:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:03.495 19:28:50 -- nvmf/common.sh@717 -- # local ip 00:22:03.495 19:28:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:03.495 19:28:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:03.495 19:28:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:03.495 19:28:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:03.495 19:28:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:03.495 19:28:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:03.495 19:28:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:03.495 19:28:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:03.495 19:28:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:03.495 19:28:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:03.495 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.495 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.755 nvme0n1 00:22:03.755 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.755 19:28:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:03.755 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.755 19:28:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:03.755 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.755 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.755 19:28:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.755 19:28:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.755 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.755 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:03.755 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:03.755 19:28:50 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:03.755 19:28:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.755 19:28:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:22:03.755 19:28:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.755 19:28:50 -- host/auth.sh@44 -- # digest=sha512 00:22:03.755 19:28:50 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:03.755 19:28:50 -- host/auth.sh@44 -- # keyid=0 00:22:03.755 19:28:50 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:03.755 19:28:50 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:03.755 19:28:50 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:03.755 19:28:50 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:03.755 19:28:50 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:22:03.755 19:28:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.755 19:28:50 -- host/auth.sh@68 -- # digest=sha512 00:22:03.755 19:28:50 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:03.755 19:28:50 -- host/auth.sh@68 -- # keyid=0 00:22:03.755 19:28:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:03.755 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:03.755 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:04.014 19:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.014 19:28:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:04.014 19:28:50 -- nvmf/common.sh@717 -- # local ip 00:22:04.014 19:28:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:04.014 19:28:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:04.014 19:28:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:04.014 19:28:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:04.014 19:28:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:04.014 19:28:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:04.014 19:28:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:04.014 19:28:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:04.014 19:28:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:04.014 19:28:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:04.014 19:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.014 19:28:50 -- common/autotest_common.sh@10 -- # set +x 00:22:04.274 nvme0n1 00:22:04.274 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.274 19:28:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:04.274 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.274 19:28:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:04.274 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.274 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.274 19:28:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:04.274 19:28:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:04.274 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.274 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.274 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.274 19:28:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:04.274 19:28:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:22:04.274 19:28:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:04.274 19:28:51 -- host/auth.sh@44 -- # digest=sha512 00:22:04.274 19:28:51 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:04.274 19:28:51 -- host/auth.sh@44 -- # keyid=1 00:22:04.274 19:28:51 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:04.274 19:28:51 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:04.274 19:28:51 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:04.274 19:28:51 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:04.274 19:28:51 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:22:04.274 19:28:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:04.274 19:28:51 -- host/auth.sh@68 -- # digest=sha512 00:22:04.274 19:28:51 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:04.274 19:28:51 -- host/auth.sh@68 -- # keyid=1 00:22:04.274 19:28:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:04.274 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.274 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.274 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.274 19:28:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:04.274 19:28:51 -- nvmf/common.sh@717 -- # local ip 00:22:04.274 19:28:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:04.274 19:28:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:04.274 19:28:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:04.274 19:28:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:04.274 19:28:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:04.274 19:28:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:04.274 19:28:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:04.274 19:28:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:04.274 19:28:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:04.274 19:28:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:04.274 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.274 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.842 nvme0n1 00:22:04.842 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.842 19:28:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:04.842 19:28:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:04.842 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.842 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.842 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.842 19:28:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:04.842 19:28:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:04.842 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.842 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.842 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.842 19:28:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:04.842 19:28:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:22:04.842 19:28:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:04.842 19:28:51 -- host/auth.sh@44 -- # digest=sha512 00:22:04.842 19:28:51 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:04.842 19:28:51 -- host/auth.sh@44 -- # keyid=2 00:22:04.842 19:28:51 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:04.842 19:28:51 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:04.842 19:28:51 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:04.842 19:28:51 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:04.842 19:28:51 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:22:04.842 19:28:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:04.842 19:28:51 -- host/auth.sh@68 -- # digest=sha512 00:22:04.842 19:28:51 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:04.842 19:28:51 -- host/auth.sh@68 -- # keyid=2 00:22:04.842 19:28:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:04.842 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.842 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:04.842 19:28:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.842 19:28:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:04.842 19:28:51 -- nvmf/common.sh@717 -- # local ip 00:22:04.842 19:28:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:04.842 19:28:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:04.842 19:28:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:04.842 19:28:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:04.842 19:28:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:04.842 19:28:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:04.842 19:28:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:04.842 19:28:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:04.842 19:28:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:04.842 19:28:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:04.842 19:28:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.842 19:28:51 -- common/autotest_common.sh@10 -- # set +x 00:22:05.102 nvme0n1 00:22:05.102 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.102 19:28:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:05.102 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.102 19:28:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:05.102 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.102 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.102 19:28:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:05.102 19:28:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:05.102 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.102 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.102 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.102 19:28:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:05.102 19:28:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:22:05.102 19:28:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:05.102 19:28:52 -- host/auth.sh@44 -- # digest=sha512 00:22:05.102 19:28:52 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:05.102 19:28:52 -- host/auth.sh@44 -- # keyid=3 00:22:05.102 19:28:52 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:05.102 19:28:52 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:05.102 19:28:52 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:05.102 19:28:52 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:05.102 19:28:52 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:22:05.102 19:28:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:05.102 19:28:52 -- host/auth.sh@68 -- # digest=sha512 00:22:05.102 19:28:52 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:05.102 19:28:52 -- host/auth.sh@68 -- # keyid=3 00:22:05.102 19:28:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:05.102 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.102 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.102 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.102 19:28:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:05.102 19:28:52 -- nvmf/common.sh@717 -- # local ip 00:22:05.102 19:28:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:05.102 19:28:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:05.102 19:28:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:05.102 19:28:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:05.102 19:28:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:05.102 19:28:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:05.102 19:28:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:05.102 19:28:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:05.102 19:28:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:05.102 19:28:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:05.361 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.361 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.620 nvme0n1 00:22:05.620 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.620 19:28:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:05.620 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.620 19:28:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:05.620 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.620 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.620 19:28:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:05.620 19:28:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:05.620 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.620 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.620 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.620 19:28:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:05.620 19:28:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:22:05.620 19:28:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:05.620 19:28:52 -- host/auth.sh@44 -- # digest=sha512 00:22:05.620 19:28:52 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:05.620 19:28:52 -- host/auth.sh@44 -- # keyid=4 00:22:05.620 19:28:52 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:05.620 19:28:52 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:05.620 19:28:52 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:05.620 19:28:52 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:05.620 19:28:52 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:22:05.620 19:28:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:05.620 19:28:52 -- host/auth.sh@68 -- # digest=sha512 00:22:05.620 19:28:52 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:05.620 19:28:52 -- host/auth.sh@68 -- # keyid=4 00:22:05.620 19:28:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:05.620 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.620 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:05.620 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:05.620 19:28:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:05.620 19:28:52 -- nvmf/common.sh@717 -- # local ip 00:22:05.620 19:28:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:05.620 19:28:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:05.620 19:28:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:05.620 19:28:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:05.620 19:28:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:05.620 19:28:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:05.620 19:28:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:05.620 19:28:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:05.620 19:28:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:05.621 19:28:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:05.621 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:05.621 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:06.188 nvme0n1 00:22:06.188 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.188 19:28:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:06.188 19:28:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:06.188 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.188 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:06.188 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.188 19:28:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:06.188 19:28:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:06.188 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.188 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:06.188 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.188 19:28:52 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:06.188 19:28:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:06.188 19:28:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:22:06.188 19:28:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:06.188 19:28:52 -- host/auth.sh@44 -- # digest=sha512 00:22:06.188 19:28:52 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:06.188 19:28:52 -- host/auth.sh@44 -- # keyid=0 00:22:06.188 19:28:52 -- host/auth.sh@45 -- # key=DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:06.188 19:28:52 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:06.188 19:28:52 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:06.188 19:28:52 -- host/auth.sh@49 -- # echo DHHC-1:00:MmQ0MThiMzY5NjMwMDVjOGM0NzJmMmNkZDljNjFhZGSVQnj6: 00:22:06.188 19:28:52 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:22:06.188 19:28:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:06.188 19:28:52 -- host/auth.sh@68 -- # digest=sha512 00:22:06.188 19:28:52 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:06.188 19:28:52 -- host/auth.sh@68 -- # keyid=0 00:22:06.188 19:28:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:06.188 19:28:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.188 19:28:52 -- common/autotest_common.sh@10 -- # set +x 00:22:06.188 19:28:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.188 19:28:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:06.188 19:28:53 -- nvmf/common.sh@717 -- # local ip 00:22:06.188 19:28:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:06.188 19:28:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:06.188 19:28:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:06.188 19:28:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:06.188 19:28:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:06.188 19:28:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:06.188 19:28:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:06.188 19:28:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:06.188 19:28:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:06.188 19:28:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:06.188 19:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.188 19:28:53 -- common/autotest_common.sh@10 -- # set +x 00:22:06.756 nvme0n1 00:22:06.756 19:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.756 19:28:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:06.756 19:28:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:06.756 19:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.756 19:28:53 -- common/autotest_common.sh@10 -- # set +x 00:22:06.756 19:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.756 19:28:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:06.756 19:28:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:06.756 19:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.756 19:28:53 -- common/autotest_common.sh@10 -- # set +x 00:22:06.756 19:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.756 19:28:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:06.756 19:28:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:22:06.756 19:28:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:06.756 19:28:53 -- host/auth.sh@44 -- # digest=sha512 00:22:06.756 19:28:53 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:06.756 19:28:53 -- host/auth.sh@44 -- # keyid=1 00:22:06.756 19:28:53 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:06.756 19:28:53 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:06.756 19:28:53 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:06.756 19:28:53 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:06.756 19:28:53 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:22:06.756 19:28:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:06.757 19:28:53 -- host/auth.sh@68 -- # digest=sha512 00:22:06.757 19:28:53 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:06.757 19:28:53 -- host/auth.sh@68 -- # keyid=1 00:22:06.757 19:28:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:06.757 19:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.757 19:28:53 -- common/autotest_common.sh@10 -- # set +x 00:22:06.757 19:28:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:06.757 19:28:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:06.757 19:28:53 -- nvmf/common.sh@717 -- # local ip 00:22:06.757 19:28:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:06.757 19:28:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:06.757 19:28:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:06.757 19:28:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:06.757 19:28:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:06.757 19:28:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:06.757 19:28:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:06.757 19:28:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:06.757 19:28:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:06.757 19:28:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:06.757 19:28:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:06.757 19:28:53 -- common/autotest_common.sh@10 -- # set +x 00:22:07.325 nvme0n1 00:22:07.325 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.325 19:28:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:07.325 19:28:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:07.325 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.325 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.325 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.325 19:28:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:07.325 19:28:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:07.325 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.325 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.325 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.325 19:28:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:07.325 19:28:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:22:07.325 19:28:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:07.325 19:28:54 -- host/auth.sh@44 -- # digest=sha512 00:22:07.325 19:28:54 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:07.325 19:28:54 -- host/auth.sh@44 -- # keyid=2 00:22:07.325 19:28:54 -- host/auth.sh@45 -- # key=DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:07.325 19:28:54 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:07.325 19:28:54 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:07.325 19:28:54 -- host/auth.sh@49 -- # echo DHHC-1:01:YzY4M2Q1YTZiYjg1ZDI0YTk3NGU4NTA3ODlhZTJjMGK+HrQ7: 00:22:07.325 19:28:54 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:22:07.325 19:28:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:07.325 19:28:54 -- host/auth.sh@68 -- # digest=sha512 00:22:07.325 19:28:54 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:07.325 19:28:54 -- host/auth.sh@68 -- # keyid=2 00:22:07.325 19:28:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:07.325 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.325 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.325 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.325 19:28:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:07.325 19:28:54 -- nvmf/common.sh@717 -- # local ip 00:22:07.325 19:28:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:07.325 19:28:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:07.325 19:28:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:07.325 19:28:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:07.325 19:28:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:07.325 19:28:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:07.325 19:28:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:07.325 19:28:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:07.325 19:28:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:07.325 19:28:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:07.325 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.325 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.892 nvme0n1 00:22:07.892 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.892 19:28:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:07.892 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.893 19:28:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:07.893 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.893 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.893 19:28:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:07.893 19:28:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:07.893 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.893 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.893 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.893 19:28:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:07.893 19:28:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:22:07.893 19:28:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:07.893 19:28:54 -- host/auth.sh@44 -- # digest=sha512 00:22:07.893 19:28:54 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:07.893 19:28:54 -- host/auth.sh@44 -- # keyid=3 00:22:07.893 19:28:54 -- host/auth.sh@45 -- # key=DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:07.893 19:28:54 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:07.893 19:28:54 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:07.893 19:28:54 -- host/auth.sh@49 -- # echo DHHC-1:02:NDlkMWVhNWRiMTA5NTk5ZmEyYWVlNGEyYTg3MWRkODM2NzhjODZiNDA3NzNhYThkC5gL8A==: 00:22:07.893 19:28:54 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:22:07.893 19:28:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:07.893 19:28:54 -- host/auth.sh@68 -- # digest=sha512 00:22:07.893 19:28:54 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:07.893 19:28:54 -- host/auth.sh@68 -- # keyid=3 00:22:07.893 19:28:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:07.893 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.893 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:07.893 19:28:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.893 19:28:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:07.893 19:28:54 -- nvmf/common.sh@717 -- # local ip 00:22:07.893 19:28:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:07.893 19:28:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:07.893 19:28:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:07.893 19:28:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:07.893 19:28:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:07.893 19:28:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:07.893 19:28:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:07.893 19:28:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:07.893 19:28:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:07.893 19:28:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:07.893 19:28:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.893 19:28:54 -- common/autotest_common.sh@10 -- # set +x 00:22:08.461 nvme0n1 00:22:08.461 19:28:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:08.461 19:28:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:08.461 19:28:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:08.461 19:28:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:08.461 19:28:55 -- common/autotest_common.sh@10 -- # set +x 00:22:08.720 19:28:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:08.720 19:28:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:08.720 19:28:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:08.720 19:28:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:08.720 19:28:55 -- common/autotest_common.sh@10 -- # set +x 00:22:08.720 19:28:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:08.720 19:28:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:08.720 19:28:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:22:08.720 19:28:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:08.720 19:28:55 -- host/auth.sh@44 -- # digest=sha512 00:22:08.720 19:28:55 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:08.720 19:28:55 -- host/auth.sh@44 -- # keyid=4 00:22:08.720 19:28:55 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:08.720 19:28:55 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:08.720 19:28:55 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:08.720 19:28:55 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk2NTJkN2Y2ZDE5OWYzMTI1NzMyMTk4MmY0OGEwM2I0MjFkNGZlOTY4YjBjMDI4OWI5MzNkN2RiOWQzYzdlZakU7sI=: 00:22:08.720 19:28:55 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:22:08.720 19:28:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:08.720 19:28:55 -- host/auth.sh@68 -- # digest=sha512 00:22:08.720 19:28:55 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:08.720 19:28:55 -- host/auth.sh@68 -- # keyid=4 00:22:08.720 19:28:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:08.720 19:28:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:08.720 19:28:55 -- common/autotest_common.sh@10 -- # set +x 00:22:08.720 19:28:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:08.720 19:28:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:08.720 19:28:55 -- nvmf/common.sh@717 -- # local ip 00:22:08.720 19:28:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:08.720 19:28:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:08.720 19:28:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:08.720 19:28:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:08.720 19:28:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:08.720 19:28:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:08.720 19:28:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:08.720 19:28:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:08.720 19:28:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:08.720 19:28:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:08.720 19:28:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:08.720 19:28:55 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 nvme0n1 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:09.289 19:28:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:22:09.289 19:28:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:09.289 19:28:56 -- host/auth.sh@44 -- # digest=sha256 00:22:09.289 19:28:56 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:09.289 19:28:56 -- host/auth.sh@44 -- # keyid=1 00:22:09.289 19:28:56 -- host/auth.sh@45 -- # key=DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:09.289 19:28:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:22:09.289 19:28:56 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:09.289 19:28:56 -- host/auth.sh@49 -- # echo DHHC-1:00:YzYwMGI2YTBiZDE2Y2VhMzQ0ODQ4ZDUzNzhjMzk0YWFhNDAyZWE1ZWFmYTBhZmQxNSml/A==: 00:22:09.289 19:28:56 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@119 -- # get_main_ns_ip 00:22:09.289 19:28:56 -- nvmf/common.sh@717 -- # local ip 00:22:09.289 19:28:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:09.289 19:28:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:09.289 19:28:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:09.289 19:28:56 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:09.289 19:28:56 -- common/autotest_common.sh@638 -- # local es=0 00:22:09.289 19:28:56 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:09.289 19:28:56 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:22:09.289 19:28:56 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 request: 00:22:09.289 { 00:22:09.289 "name": "nvme0", 00:22:09.289 "trtype": "rdma", 00:22:09.289 "traddr": "192.168.100.8", 00:22:09.289 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:22:09.289 "adrfam": "ipv4", 00:22:09.289 "trsvcid": "4420", 00:22:09.289 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:22:09.289 "method": "bdev_nvme_attach_controller", 00:22:09.289 "req_id": 1 00:22:09.289 } 00:22:09.289 Got JSON-RPC error response 00:22:09.289 response: 00:22:09.289 { 00:22:09.289 "code": -32602, 00:22:09.289 "message": "Invalid parameters" 00:22:09.289 } 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:22:09.289 19:28:56 -- common/autotest_common.sh@641 -- # es=1 00:22:09.289 19:28:56 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:22:09.289 19:28:56 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:22:09.289 19:28:56 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:22:09.289 19:28:56 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.289 19:28:56 -- host/auth.sh@121 -- # jq length 00:22:09.289 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.289 19:28:56 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:22:09.289 19:28:56 -- host/auth.sh@124 -- # get_main_ns_ip 00:22:09.289 19:28:56 -- nvmf/common.sh@717 -- # local ip 00:22:09.289 19:28:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:09.289 19:28:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:09.289 19:28:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:09.289 19:28:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:09.289 19:28:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:09.289 19:28:56 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:09.289 19:28:56 -- common/autotest_common.sh@638 -- # local es=0 00:22:09.289 19:28:56 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:09.289 19:28:56 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:22:09.289 19:28:56 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:22:09.289 19:28:56 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:09.289 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.289 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.548 request: 00:22:09.548 { 00:22:09.548 "name": "nvme0", 00:22:09.548 "trtype": "rdma", 00:22:09.548 "traddr": "192.168.100.8", 00:22:09.548 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:22:09.548 "adrfam": "ipv4", 00:22:09.548 "trsvcid": "4420", 00:22:09.548 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:22:09.548 "dhchap_key": "key2", 00:22:09.548 "method": "bdev_nvme_attach_controller", 00:22:09.548 "req_id": 1 00:22:09.548 } 00:22:09.548 Got JSON-RPC error response 00:22:09.548 response: 00:22:09.548 { 00:22:09.548 "code": -32602, 00:22:09.548 "message": "Invalid parameters" 00:22:09.548 } 00:22:09.548 19:28:56 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:22:09.548 19:28:56 -- common/autotest_common.sh@641 -- # es=1 00:22:09.548 19:28:56 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:22:09.548 19:28:56 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:22:09.548 19:28:56 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:22:09.548 19:28:56 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.548 19:28:56 -- host/auth.sh@127 -- # jq length 00:22:09.548 19:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:09.548 19:28:56 -- common/autotest_common.sh@10 -- # set +x 00:22:09.548 19:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:09.548 19:28:56 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:22:09.548 19:28:56 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:22:09.548 19:28:56 -- host/auth.sh@130 -- # cleanup 00:22:09.548 19:28:56 -- host/auth.sh@24 -- # nvmftestfini 00:22:09.548 19:28:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:09.548 19:28:56 -- nvmf/common.sh@117 -- # sync 00:22:09.548 19:28:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:09.548 19:28:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:09.548 19:28:56 -- nvmf/common.sh@120 -- # set +e 00:22:09.548 19:28:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:09.548 19:28:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:09.548 rmmod nvme_rdma 00:22:09.548 rmmod nvme_fabrics 00:22:09.548 19:28:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:09.548 19:28:56 -- nvmf/common.sh@124 -- # set -e 00:22:09.548 19:28:56 -- nvmf/common.sh@125 -- # return 0 00:22:09.548 19:28:56 -- nvmf/common.sh@478 -- # '[' -n 3099055 ']' 00:22:09.548 19:28:56 -- nvmf/common.sh@479 -- # killprocess 3099055 00:22:09.548 19:28:56 -- common/autotest_common.sh@936 -- # '[' -z 3099055 ']' 00:22:09.548 19:28:56 -- common/autotest_common.sh@940 -- # kill -0 3099055 00:22:09.548 19:28:56 -- common/autotest_common.sh@941 -- # uname 00:22:09.548 19:28:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:09.548 19:28:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3099055 00:22:09.549 19:28:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:09.549 19:28:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:09.549 19:28:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3099055' 00:22:09.549 killing process with pid 3099055 00:22:09.549 19:28:56 -- common/autotest_common.sh@955 -- # kill 3099055 00:22:09.549 19:28:56 -- common/autotest_common.sh@960 -- # wait 3099055 00:22:09.808 19:28:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:09.808 19:28:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:09.808 19:28:56 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:22:09.808 19:28:56 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:22:09.808 19:28:56 -- host/auth.sh@27 -- # clean_kernel_target 00:22:09.808 19:28:56 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:22:09.808 19:28:56 -- nvmf/common.sh@675 -- # echo 0 00:22:09.808 19:28:56 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:22:09.808 19:28:56 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:22:09.808 19:28:56 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:22:09.808 19:28:56 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:22:09.808 19:28:56 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:22:09.808 19:28:56 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:22:10.067 19:28:56 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:22:13.357 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:22:13.357 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:22:14.737 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:22:14.996 19:29:01 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.tN9 /tmp/spdk.key-null.fY4 /tmp/spdk.key-sha256.oxO /tmp/spdk.key-sha384.Zq8 /tmp/spdk.key-sha512.MtJ /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:22:14.996 19:29:01 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:22:18.290 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:22:18.290 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:22:18.290 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:22:18.291 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:22:18.291 00:22:18.291 real 0m56.846s 00:22:18.291 user 0m45.928s 00:22:18.291 sys 0m14.638s 00:22:18.291 19:29:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:18.291 19:29:05 -- common/autotest_common.sh@10 -- # set +x 00:22:18.291 ************************************ 00:22:18.291 END TEST nvmf_auth 00:22:18.291 ************************************ 00:22:18.291 19:29:05 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:22:18.291 19:29:05 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:22:18.291 19:29:05 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:22:18.291 19:29:05 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:22:18.291 19:29:05 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:22:18.291 19:29:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:18.291 19:29:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:18.291 19:29:05 -- common/autotest_common.sh@10 -- # set +x 00:22:18.551 ************************************ 00:22:18.551 START TEST nvmf_bdevperf 00:22:18.551 ************************************ 00:22:18.551 19:29:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:22:18.551 * Looking for test storage... 00:22:18.551 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:18.551 19:29:05 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:18.551 19:29:05 -- nvmf/common.sh@7 -- # uname -s 00:22:18.551 19:29:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:18.551 19:29:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:18.551 19:29:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:18.551 19:29:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:18.551 19:29:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:18.551 19:29:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:18.551 19:29:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:18.551 19:29:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:18.551 19:29:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:18.551 19:29:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:18.551 19:29:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:22:18.551 19:29:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:22:18.551 19:29:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:18.551 19:29:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:18.551 19:29:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:18.551 19:29:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:18.551 19:29:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:18.551 19:29:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:18.551 19:29:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:18.551 19:29:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:18.551 19:29:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.551 19:29:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.551 19:29:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.551 19:29:05 -- paths/export.sh@5 -- # export PATH 00:22:18.551 19:29:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:18.551 19:29:05 -- nvmf/common.sh@47 -- # : 0 00:22:18.551 19:29:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:18.551 19:29:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:18.551 19:29:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:18.551 19:29:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:18.552 19:29:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:18.811 19:29:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:18.811 19:29:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:18.811 19:29:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:18.811 19:29:05 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:18.811 19:29:05 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:18.811 19:29:05 -- host/bdevperf.sh@24 -- # nvmftestinit 00:22:18.811 19:29:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:18.811 19:29:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:18.811 19:29:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:18.811 19:29:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:18.811 19:29:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:18.811 19:29:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.811 19:29:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:18.811 19:29:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.811 19:29:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:18.811 19:29:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:18.811 19:29:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:18.811 19:29:05 -- common/autotest_common.sh@10 -- # set +x 00:22:25.382 19:29:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:25.382 19:29:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:25.382 19:29:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:25.382 19:29:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:25.382 19:29:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:25.382 19:29:11 -- nvmf/common.sh@295 -- # net_devs=() 00:22:25.382 19:29:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@296 -- # e810=() 00:22:25.382 19:29:11 -- nvmf/common.sh@296 -- # local -ga e810 00:22:25.382 19:29:11 -- nvmf/common.sh@297 -- # x722=() 00:22:25.382 19:29:11 -- nvmf/common.sh@297 -- # local -ga x722 00:22:25.382 19:29:11 -- nvmf/common.sh@298 -- # mlx=() 00:22:25.382 19:29:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:25.382 19:29:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:25.382 19:29:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:25.382 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:25.382 19:29:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:25.382 19:29:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:25.382 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:25.382 19:29:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:25.382 19:29:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.382 19:29:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.382 19:29:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:25.382 Found net devices under 0000:18:00.0: mlx_0_0 00:22:25.382 19:29:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.382 19:29:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.382 19:29:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:25.382 Found net devices under 0000:18:00.1: mlx_0_1 00:22:25.382 19:29:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.382 19:29:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:25.382 19:29:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:25.382 19:29:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:25.382 19:29:11 -- nvmf/common.sh@58 -- # uname 00:22:25.382 19:29:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:25.382 19:29:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:25.382 19:29:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:25.382 19:29:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:25.382 19:29:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:25.382 19:29:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:25.382 19:29:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:25.382 19:29:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:25.382 19:29:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:25.382 19:29:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:25.382 19:29:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:25.382 19:29:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:25.382 19:29:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:25.382 19:29:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:25.382 19:29:11 -- nvmf/common.sh@105 -- # continue 2 00:22:25.382 19:29:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:25.382 19:29:11 -- nvmf/common.sh@105 -- # continue 2 00:22:25.382 19:29:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:25.382 19:29:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:25.382 19:29:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:25.382 19:29:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:25.382 19:29:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:25.382 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:25.382 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:22:25.382 altname enp24s0f0np0 00:22:25.382 altname ens785f0np0 00:22:25.382 inet 192.168.100.8/24 scope global mlx_0_0 00:22:25.382 valid_lft forever preferred_lft forever 00:22:25.382 19:29:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:25.382 19:29:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:25.382 19:29:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:25.382 19:29:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:25.382 19:29:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:25.382 19:29:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:25.382 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:25.382 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:22:25.382 altname enp24s0f1np1 00:22:25.382 altname ens785f1np1 00:22:25.382 inet 192.168.100.9/24 scope global mlx_0_1 00:22:25.382 valid_lft forever preferred_lft forever 00:22:25.382 19:29:11 -- nvmf/common.sh@411 -- # return 0 00:22:25.382 19:29:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:25.382 19:29:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:25.382 19:29:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:25.382 19:29:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:25.382 19:29:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:25.382 19:29:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:25.382 19:29:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:25.382 19:29:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:25.382 19:29:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:25.382 19:29:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:25.382 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.383 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:25.383 19:29:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:25.383 19:29:11 -- nvmf/common.sh@105 -- # continue 2 00:22:25.383 19:29:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:25.383 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.383 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:25.383 19:29:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:25.383 19:29:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:25.383 19:29:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:25.383 19:29:11 -- nvmf/common.sh@105 -- # continue 2 00:22:25.383 19:29:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:25.383 19:29:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:25.383 19:29:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:25.383 19:29:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:25.383 19:29:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:25.383 19:29:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:25.383 19:29:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:25.383 19:29:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:25.383 192.168.100.9' 00:22:25.383 19:29:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:25.383 192.168.100.9' 00:22:25.383 19:29:12 -- nvmf/common.sh@446 -- # head -n 1 00:22:25.383 19:29:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:25.383 19:29:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:25.383 192.168.100.9' 00:22:25.383 19:29:12 -- nvmf/common.sh@447 -- # tail -n +2 00:22:25.383 19:29:12 -- nvmf/common.sh@447 -- # head -n 1 00:22:25.383 19:29:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:25.383 19:29:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:25.383 19:29:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:25.383 19:29:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:25.383 19:29:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:25.383 19:29:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:25.383 19:29:12 -- host/bdevperf.sh@25 -- # tgt_init 00:22:25.383 19:29:12 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:22:25.383 19:29:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:25.383 19:29:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:25.383 19:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:25.383 19:29:12 -- nvmf/common.sh@470 -- # nvmfpid=3111233 00:22:25.383 19:29:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:25.383 19:29:12 -- nvmf/common.sh@471 -- # waitforlisten 3111233 00:22:25.383 19:29:12 -- common/autotest_common.sh@817 -- # '[' -z 3111233 ']' 00:22:25.383 19:29:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:25.383 19:29:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:25.383 19:29:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:25.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:25.383 19:29:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:25.383 19:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:25.383 [2024-04-24 19:29:12.102269] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:25.383 [2024-04-24 19:29:12.102325] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:25.383 EAL: No free 2048 kB hugepages reported on node 1 00:22:25.383 [2024-04-24 19:29:12.171095] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:25.383 [2024-04-24 19:29:12.257248] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:25.383 [2024-04-24 19:29:12.257293] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:25.383 [2024-04-24 19:29:12.257303] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:25.383 [2024-04-24 19:29:12.257312] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:25.383 [2024-04-24 19:29:12.257319] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:25.383 [2024-04-24 19:29:12.257367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:25.383 [2024-04-24 19:29:12.257447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:25.383 [2024-04-24 19:29:12.257449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:25.951 19:29:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:25.951 19:29:12 -- common/autotest_common.sh@850 -- # return 0 00:22:25.951 19:29:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:25.951 19:29:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:25.951 19:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:25.951 19:29:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:25.951 19:29:12 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:25.951 19:29:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:25.951 19:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:26.210 [2024-04-24 19:29:12.986994] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x121aa30/0x121ef20) succeed. 00:22:26.210 [2024-04-24 19:29:12.997292] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x121bfd0/0x12605b0) succeed. 00:22:26.210 19:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.210 19:29:13 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:26.210 19:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.210 19:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:26.210 Malloc0 00:22:26.210 19:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.210 19:29:13 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:26.210 19:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.211 19:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:26.211 19:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.211 19:29:13 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:26.211 19:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.211 19:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:26.211 19:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.211 19:29:13 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:26.211 19:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:26.211 19:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:26.211 [2024-04-24 19:29:13.143642] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:26.211 19:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:26.211 19:29:13 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:22:26.211 19:29:13 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:22:26.211 19:29:13 -- nvmf/common.sh@521 -- # config=() 00:22:26.211 19:29:13 -- nvmf/common.sh@521 -- # local subsystem config 00:22:26.211 19:29:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:26.211 19:29:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:26.211 { 00:22:26.211 "params": { 00:22:26.211 "name": "Nvme$subsystem", 00:22:26.211 "trtype": "$TEST_TRANSPORT", 00:22:26.211 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:26.211 "adrfam": "ipv4", 00:22:26.211 "trsvcid": "$NVMF_PORT", 00:22:26.211 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:26.211 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:26.211 "hdgst": ${hdgst:-false}, 00:22:26.211 "ddgst": ${ddgst:-false} 00:22:26.211 }, 00:22:26.211 "method": "bdev_nvme_attach_controller" 00:22:26.211 } 00:22:26.211 EOF 00:22:26.211 )") 00:22:26.211 19:29:13 -- nvmf/common.sh@543 -- # cat 00:22:26.211 19:29:13 -- nvmf/common.sh@545 -- # jq . 00:22:26.211 19:29:13 -- nvmf/common.sh@546 -- # IFS=, 00:22:26.211 19:29:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:26.211 "params": { 00:22:26.211 "name": "Nvme1", 00:22:26.211 "trtype": "rdma", 00:22:26.211 "traddr": "192.168.100.8", 00:22:26.211 "adrfam": "ipv4", 00:22:26.211 "trsvcid": "4420", 00:22:26.211 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:26.211 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:26.211 "hdgst": false, 00:22:26.211 "ddgst": false 00:22:26.211 }, 00:22:26.211 "method": "bdev_nvme_attach_controller" 00:22:26.211 }' 00:22:26.211 [2024-04-24 19:29:13.197675] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:26.211 [2024-04-24 19:29:13.197740] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3111374 ] 00:22:26.470 EAL: No free 2048 kB hugepages reported on node 1 00:22:26.470 [2024-04-24 19:29:13.273378] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:26.470 [2024-04-24 19:29:13.358879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:26.728 Running I/O for 1 seconds... 00:22:27.664 00:22:27.664 Latency(us) 00:22:27.664 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:27.664 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:27.664 Verification LBA range: start 0x0 length 0x4000 00:22:27.664 Nvme1n1 : 1.01 18270.76 71.37 0.00 0.00 6961.28 1381.95 12081.42 00:22:27.664 =================================================================================================================== 00:22:27.664 Total : 18270.76 71.37 0.00 0.00 6961.28 1381.95 12081.42 00:22:27.923 19:29:14 -- host/bdevperf.sh@30 -- # bdevperfpid=3111624 00:22:27.923 19:29:14 -- host/bdevperf.sh@32 -- # sleep 3 00:22:27.923 19:29:14 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:22:27.923 19:29:14 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:22:27.923 19:29:14 -- nvmf/common.sh@521 -- # config=() 00:22:27.923 19:29:14 -- nvmf/common.sh@521 -- # local subsystem config 00:22:27.923 19:29:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:27.923 19:29:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:27.923 { 00:22:27.923 "params": { 00:22:27.923 "name": "Nvme$subsystem", 00:22:27.923 "trtype": "$TEST_TRANSPORT", 00:22:27.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.923 "adrfam": "ipv4", 00:22:27.923 "trsvcid": "$NVMF_PORT", 00:22:27.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.923 "hdgst": ${hdgst:-false}, 00:22:27.923 "ddgst": ${ddgst:-false} 00:22:27.923 }, 00:22:27.923 "method": "bdev_nvme_attach_controller" 00:22:27.923 } 00:22:27.923 EOF 00:22:27.923 )") 00:22:27.923 19:29:14 -- nvmf/common.sh@543 -- # cat 00:22:27.923 19:29:14 -- nvmf/common.sh@545 -- # jq . 00:22:27.923 19:29:14 -- nvmf/common.sh@546 -- # IFS=, 00:22:27.923 19:29:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:27.923 "params": { 00:22:27.923 "name": "Nvme1", 00:22:27.923 "trtype": "rdma", 00:22:27.923 "traddr": "192.168.100.8", 00:22:27.923 "adrfam": "ipv4", 00:22:27.923 "trsvcid": "4420", 00:22:27.923 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:27.923 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:27.923 "hdgst": false, 00:22:27.923 "ddgst": false 00:22:27.923 }, 00:22:27.923 "method": "bdev_nvme_attach_controller" 00:22:27.923 }' 00:22:27.923 [2024-04-24 19:29:14.864669] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:27.923 [2024-04-24 19:29:14.864735] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3111624 ] 00:22:27.923 EAL: No free 2048 kB hugepages reported on node 1 00:22:27.923 [2024-04-24 19:29:14.936757] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:28.186 [2024-04-24 19:29:15.020818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:28.186 Running I/O for 15 seconds... 00:22:31.472 19:29:17 -- host/bdevperf.sh@33 -- # kill -9 3111233 00:22:31.472 19:29:17 -- host/bdevperf.sh@35 -- # sleep 3 00:22:32.123 [2024-04-24 19:29:18.864238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:120112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:120120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:120128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:120136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:120144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:120152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:120160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:120168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:120176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.123 [2024-04-24 19:29:18.864475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.123 [2024-04-24 19:29:18.864486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:120184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:120192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:120200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:120208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:120216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:120224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:120232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:120240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:120248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:120256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:120264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:120272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:120280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:120288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:120296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:120304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:120312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:120320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:120328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:120336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:120344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:120352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:120360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:120368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:120376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.864988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:120384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.864998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:120392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:120400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:120408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:120416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:120424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:120432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:120440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:120448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:120456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:120464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:120472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:120480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:120488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.124 [2024-04-24 19:29:18.865266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:120496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.124 [2024-04-24 19:29:18.865274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:120504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:120512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:120520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:120528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:120536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:120544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:120552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:120560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:120568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:120576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:120584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:120592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:120600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:120608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:120616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:120624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:120632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:120640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:120648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:120656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:120664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:120672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:120680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:120688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:120696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:120704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:120712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:120720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:120728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:120736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:120744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:120752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:120760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:120768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:120776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.865983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.865994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:120784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.866003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.866013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:120792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.866022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.866033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:120800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.866043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.125 [2024-04-24 19:29:18.866054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:120808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.125 [2024-04-24 19:29:18.866063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:120816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.126 [2024-04-24 19:29:18.866083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:120824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:32.126 [2024-04-24 19:29:18.866103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:119808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:119816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:119824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:119832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:119840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:119848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:119856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:119864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:119872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:119880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:119888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:119896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:119904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:119912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:119920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:119928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:119936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:119944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:119952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:119960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:119968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:119976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:119984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:119992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:120000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:120008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:120016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:120024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:120032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:120040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:120048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:120056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:120064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:120072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.126 [2024-04-24 19:29:18.866807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:120080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x3b700 00:22:32.126 [2024-04-24 19:29:18.866816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.127 [2024-04-24 19:29:18.866827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:120088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3b700 00:22:32.127 [2024-04-24 19:29:18.866836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.127 [2024-04-24 19:29:18.866847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:120096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3b700 00:22:32.127 [2024-04-24 19:29:18.866856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:32.127 [2024-04-24 19:29:18.868618] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:32.127 [2024-04-24 19:29:18.868634] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:32.127 [2024-04-24 19:29:18.868643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:120104 len:8 PRP1 0x0 PRP2 0x0 00:22:32.127 [2024-04-24 19:29:18.868656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:32.127 [2024-04-24 19:29:18.868699] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:22:32.127 [2024-04-24 19:29:18.871419] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:32.127 [2024-04-24 19:29:18.885763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:32.127 [2024-04-24 19:29:18.888449] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:32.127 [2024-04-24 19:29:18.888470] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:32.127 [2024-04-24 19:29:18.888479] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:33.064 [2024-04-24 19:29:19.892482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:33.065 [2024-04-24 19:29:19.892543] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:33.065 [2024-04-24 19:29:19.893021] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:33.065 [2024-04-24 19:29:19.893033] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:33.065 [2024-04-24 19:29:19.893044] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:33.065 [2024-04-24 19:29:19.893222] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:33.065 [2024-04-24 19:29:19.895821] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:33.065 [2024-04-24 19:29:19.906172] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:33.065 [2024-04-24 19:29:19.908662] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:33.065 [2024-04-24 19:29:19.908683] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:33.065 [2024-04-24 19:29:19.908692] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:34.002 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3111233 Killed "${NVMF_APP[@]}" "$@" 00:22:34.002 19:29:20 -- host/bdevperf.sh@36 -- # tgt_init 00:22:34.002 19:29:20 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:22:34.002 19:29:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:34.002 19:29:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:34.002 19:29:20 -- common/autotest_common.sh@10 -- # set +x 00:22:34.002 19:29:20 -- nvmf/common.sh@470 -- # nvmfpid=3112365 00:22:34.002 19:29:20 -- nvmf/common.sh@471 -- # waitforlisten 3112365 00:22:34.002 19:29:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:34.002 19:29:20 -- common/autotest_common.sh@817 -- # '[' -z 3112365 ']' 00:22:34.002 19:29:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:34.002 19:29:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:34.003 19:29:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:34.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:34.003 19:29:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:34.003 19:29:20 -- common/autotest_common.sh@10 -- # set +x 00:22:34.003 [2024-04-24 19:29:20.886491] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:34.003 [2024-04-24 19:29:20.886544] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:34.003 [2024-04-24 19:29:20.912623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:34.003 [2024-04-24 19:29:20.912655] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:34.003 [2024-04-24 19:29:20.912835] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:34.003 [2024-04-24 19:29:20.912846] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:34.003 [2024-04-24 19:29:20.912858] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:34.003 [2024-04-24 19:29:20.915305] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:34.003 [2024-04-24 19:29:20.915637] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:34.003 EAL: No free 2048 kB hugepages reported on node 1 00:22:34.003 [2024-04-24 19:29:20.928325] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:34.003 [2024-04-24 19:29:20.930690] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:34.003 [2024-04-24 19:29:20.930711] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:34.003 [2024-04-24 19:29:20.930720] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:34.003 [2024-04-24 19:29:20.962056] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:34.262 [2024-04-24 19:29:21.048870] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:34.262 [2024-04-24 19:29:21.048904] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:34.262 [2024-04-24 19:29:21.048914] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:34.262 [2024-04-24 19:29:21.048922] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:34.262 [2024-04-24 19:29:21.048930] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:34.262 [2024-04-24 19:29:21.048976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:34.262 [2024-04-24 19:29:21.049057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:34.262 [2024-04-24 19:29:21.049059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:34.831 19:29:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:34.831 19:29:21 -- common/autotest_common.sh@850 -- # return 0 00:22:34.831 19:29:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:34.831 19:29:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:34.831 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:34.831 19:29:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:34.831 19:29:21 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:34.831 19:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:34.831 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:34.831 [2024-04-24 19:29:21.796801] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x219ca30/0x21a0f20) succeed. 00:22:34.831 [2024-04-24 19:29:21.806930] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x219dfd0/0x21e25b0) succeed. 00:22:35.090 19:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.090 19:29:21 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:35.091 19:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.091 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:35.091 [2024-04-24 19:29:21.934776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:35.091 [2024-04-24 19:29:21.934820] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:35.091 [2024-04-24 19:29:21.934999] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:35.091 [2024-04-24 19:29:21.935016] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:35.091 [2024-04-24 19:29:21.935028] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:35.091 [2024-04-24 19:29:21.937770] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:35.091 Malloc0 00:22:35.091 19:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.091 19:29:21 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:35.091 19:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.091 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:35.091 [2024-04-24 19:29:21.944565] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:35.091 [2024-04-24 19:29:21.947101] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:35.091 [2024-04-24 19:29:21.947122] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:35.091 [2024-04-24 19:29:21.947131] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:35.091 19:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.091 19:29:21 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:35.091 19:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.091 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:35.091 19:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.091 19:29:21 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:35.091 19:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:35.091 19:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:35.091 [2024-04-24 19:29:21.965318] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:35.091 19:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:35.091 19:29:21 -- host/bdevperf.sh@38 -- # wait 3111624 00:22:36.029 [2024-04-24 19:29:22.950954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:36.029 [2024-04-24 19:29:22.950977] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:36.029 [2024-04-24 19:29:22.951153] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:36.029 [2024-04-24 19:29:22.951164] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:36.029 [2024-04-24 19:29:22.951175] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:36.029 [2024-04-24 19:29:22.953909] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:36.029 [2024-04-24 19:29:22.959711] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:36.029 [2024-04-24 19:29:23.002464] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:44.173 00:22:44.173 Latency(us) 00:22:44.173 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:44.173 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:44.173 Verification LBA range: start 0x0 length 0x4000 00:22:44.173 Nvme1n1 : 15.01 11955.88 46.70 13756.71 0.00 4957.99 357.95 1043105.17 00:22:44.173 =================================================================================================================== 00:22:44.173 Total : 11955.88 46.70 13756.71 0.00 4957.99 357.95 1043105.17 00:22:44.173 19:29:30 -- host/bdevperf.sh@39 -- # sync 00:22:44.173 19:29:30 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:44.173 19:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:44.173 19:29:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.173 19:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:44.173 19:29:30 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:22:44.173 19:29:30 -- host/bdevperf.sh@44 -- # nvmftestfini 00:22:44.173 19:29:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:44.173 19:29:30 -- nvmf/common.sh@117 -- # sync 00:22:44.173 19:29:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:44.173 19:29:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:44.173 19:29:30 -- nvmf/common.sh@120 -- # set +e 00:22:44.173 19:29:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:44.173 19:29:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:44.173 rmmod nvme_rdma 00:22:44.173 rmmod nvme_fabrics 00:22:44.173 19:29:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:44.173 19:29:30 -- nvmf/common.sh@124 -- # set -e 00:22:44.173 19:29:30 -- nvmf/common.sh@125 -- # return 0 00:22:44.173 19:29:30 -- nvmf/common.sh@478 -- # '[' -n 3112365 ']' 00:22:44.173 19:29:30 -- nvmf/common.sh@479 -- # killprocess 3112365 00:22:44.173 19:29:30 -- common/autotest_common.sh@936 -- # '[' -z 3112365 ']' 00:22:44.173 19:29:30 -- common/autotest_common.sh@940 -- # kill -0 3112365 00:22:44.173 19:29:30 -- common/autotest_common.sh@941 -- # uname 00:22:44.173 19:29:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:44.173 19:29:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3112365 00:22:44.173 19:29:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:44.173 19:29:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:44.173 19:29:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3112365' 00:22:44.173 killing process with pid 3112365 00:22:44.173 19:29:30 -- common/autotest_common.sh@955 -- # kill 3112365 00:22:44.173 19:29:30 -- common/autotest_common.sh@960 -- # wait 3112365 00:22:44.173 [2024-04-24 19:29:30.710087] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:44.173 19:29:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:44.173 19:29:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:44.173 00:22:44.173 real 0m25.534s 00:22:44.173 user 1m5.158s 00:22:44.173 sys 0m6.267s 00:22:44.173 19:29:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:44.173 19:29:30 -- common/autotest_common.sh@10 -- # set +x 00:22:44.173 ************************************ 00:22:44.173 END TEST nvmf_bdevperf 00:22:44.173 ************************************ 00:22:44.173 19:29:31 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:22:44.173 19:29:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:44.173 19:29:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:44.173 19:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:44.173 ************************************ 00:22:44.173 START TEST nvmf_target_disconnect 00:22:44.173 ************************************ 00:22:44.173 19:29:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:22:44.437 * Looking for test storage... 00:22:44.437 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:44.437 19:29:31 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:44.437 19:29:31 -- nvmf/common.sh@7 -- # uname -s 00:22:44.437 19:29:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:44.437 19:29:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:44.437 19:29:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:44.437 19:29:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:44.437 19:29:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:44.437 19:29:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:44.437 19:29:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:44.437 19:29:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:44.437 19:29:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:44.437 19:29:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:44.437 19:29:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:22:44.437 19:29:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:22:44.437 19:29:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:44.437 19:29:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:44.437 19:29:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:44.437 19:29:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:44.437 19:29:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:44.437 19:29:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:44.437 19:29:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:44.437 19:29:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:44.437 19:29:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 19:29:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 19:29:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 19:29:31 -- paths/export.sh@5 -- # export PATH 00:22:44.438 19:29:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 19:29:31 -- nvmf/common.sh@47 -- # : 0 00:22:44.438 19:29:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:44.438 19:29:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:44.438 19:29:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:44.438 19:29:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:44.438 19:29:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:44.438 19:29:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:44.438 19:29:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:44.438 19:29:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:44.438 19:29:31 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:22:44.438 19:29:31 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:22:44.438 19:29:31 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:22:44.438 19:29:31 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:22:44.438 19:29:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:44.438 19:29:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:44.438 19:29:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:44.438 19:29:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:44.438 19:29:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:44.438 19:29:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.438 19:29:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.438 19:29:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.438 19:29:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:44.438 19:29:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:44.438 19:29:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:44.438 19:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:51.008 19:29:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.008 19:29:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:51.008 19:29:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:51.008 19:29:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:51.008 19:29:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:51.008 19:29:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:51.008 19:29:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:51.008 19:29:37 -- nvmf/common.sh@295 -- # net_devs=() 00:22:51.008 19:29:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:51.008 19:29:37 -- nvmf/common.sh@296 -- # e810=() 00:22:51.008 19:29:37 -- nvmf/common.sh@296 -- # local -ga e810 00:22:51.008 19:29:37 -- nvmf/common.sh@297 -- # x722=() 00:22:51.008 19:29:37 -- nvmf/common.sh@297 -- # local -ga x722 00:22:51.008 19:29:37 -- nvmf/common.sh@298 -- # mlx=() 00:22:51.008 19:29:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:51.008 19:29:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.008 19:29:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:51.008 19:29:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:51.008 19:29:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:51.008 19:29:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:51.008 19:29:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:51.008 19:29:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:51.008 19:29:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:51.008 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:51.008 19:29:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:51.008 19:29:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:51.008 19:29:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:51.008 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:51.008 19:29:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:51.008 19:29:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:51.008 19:29:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:51.008 19:29:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:51.008 19:29:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.008 19:29:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:51.008 19:29:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.008 19:29:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:51.008 Found net devices under 0000:18:00.0: mlx_0_0 00:22:51.008 19:29:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.008 19:29:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:51.008 19:29:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.009 19:29:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:51.009 19:29:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.009 19:29:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:51.009 Found net devices under 0000:18:00.1: mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.009 19:29:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:51.009 19:29:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:51.009 19:29:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:51.009 19:29:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:51.009 19:29:37 -- nvmf/common.sh@58 -- # uname 00:22:51.009 19:29:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:51.009 19:29:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:51.009 19:29:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:51.009 19:29:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:51.009 19:29:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:51.009 19:29:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:51.009 19:29:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:51.009 19:29:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:51.009 19:29:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:51.009 19:29:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:51.009 19:29:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:51.009 19:29:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:51.009 19:29:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:51.009 19:29:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:51.009 19:29:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:51.009 19:29:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:51.009 19:29:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@105 -- # continue 2 00:22:51.009 19:29:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@105 -- # continue 2 00:22:51.009 19:29:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:51.009 19:29:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.009 19:29:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:51.009 19:29:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:51.009 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:51.009 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:22:51.009 altname enp24s0f0np0 00:22:51.009 altname ens785f0np0 00:22:51.009 inet 192.168.100.8/24 scope global mlx_0_0 00:22:51.009 valid_lft forever preferred_lft forever 00:22:51.009 19:29:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:51.009 19:29:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:51.009 19:29:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:51.009 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:51.009 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:22:51.009 altname enp24s0f1np1 00:22:51.009 altname ens785f1np1 00:22:51.009 inet 192.168.100.9/24 scope global mlx_0_1 00:22:51.009 valid_lft forever preferred_lft forever 00:22:51.009 19:29:37 -- nvmf/common.sh@411 -- # return 0 00:22:51.009 19:29:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:51.009 19:29:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:51.009 19:29:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:51.009 19:29:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:51.009 19:29:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:51.009 19:29:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:51.009 19:29:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:51.009 19:29:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:51.009 19:29:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:51.009 19:29:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@105 -- # continue 2 00:22:51.009 19:29:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.009 19:29:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:51.009 19:29:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@105 -- # continue 2 00:22:51.009 19:29:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:51.009 19:29:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.009 19:29:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:51.009 19:29:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.009 19:29:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:51.009 19:29:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:51.009 192.168.100.9' 00:22:51.009 19:29:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:51.009 192.168.100.9' 00:22:51.009 19:29:37 -- nvmf/common.sh@446 -- # head -n 1 00:22:51.009 19:29:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:51.009 19:29:37 -- nvmf/common.sh@447 -- # tail -n +2 00:22:51.009 19:29:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:51.009 192.168.100.9' 00:22:51.009 19:29:37 -- nvmf/common.sh@447 -- # head -n 1 00:22:51.009 19:29:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:51.009 19:29:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:51.009 19:29:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:51.009 19:29:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:51.009 19:29:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:51.009 19:29:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:51.009 19:29:37 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:22:51.009 19:29:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:51.009 19:29:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:51.009 19:29:37 -- common/autotest_common.sh@10 -- # set +x 00:22:51.009 ************************************ 00:22:51.009 START TEST nvmf_target_disconnect_tc1 00:22:51.009 ************************************ 00:22:51.009 19:29:37 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:22:51.009 19:29:37 -- host/target_disconnect.sh@32 -- # set +e 00:22:51.009 19:29:37 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:22:51.009 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.009 [2024-04-24 19:29:37.703819] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:51.009 [2024-04-24 19:29:37.703941] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:51.009 [2024-04-24 19:29:37.703975] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:22:51.948 [2024-04-24 19:29:38.707942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:51.948 [2024-04-24 19:29:38.708008] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:22:51.948 [2024-04-24 19:29:38.708044] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:22:51.948 [2024-04-24 19:29:38.708110] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:22:51.948 [2024-04-24 19:29:38.708140] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:22:51.948 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:22:51.948 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:22:51.948 Initializing NVMe Controllers 00:22:51.948 19:29:38 -- host/target_disconnect.sh@33 -- # trap - ERR 00:22:51.948 19:29:38 -- host/target_disconnect.sh@33 -- # print_backtrace 00:22:51.948 19:29:38 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:22:51.948 19:29:38 -- common/autotest_common.sh@1139 -- # return 0 00:22:51.948 19:29:38 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:22:51.948 19:29:38 -- host/target_disconnect.sh@41 -- # set -e 00:22:51.948 00:22:51.948 real 0m1.129s 00:22:51.948 user 0m0.862s 00:22:51.948 sys 0m0.255s 00:22:51.948 19:29:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:51.948 19:29:38 -- common/autotest_common.sh@10 -- # set +x 00:22:51.948 ************************************ 00:22:51.948 END TEST nvmf_target_disconnect_tc1 00:22:51.948 ************************************ 00:22:51.948 19:29:38 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:22:51.948 19:29:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:51.948 19:29:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:51.948 19:29:38 -- common/autotest_common.sh@10 -- # set +x 00:22:51.948 ************************************ 00:22:51.948 START TEST nvmf_target_disconnect_tc2 00:22:51.948 ************************************ 00:22:51.948 19:29:38 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:22:51.948 19:29:38 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:22:51.948 19:29:38 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:22:51.948 19:29:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:51.948 19:29:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:51.948 19:29:38 -- common/autotest_common.sh@10 -- # set +x 00:22:51.948 19:29:38 -- nvmf/common.sh@470 -- # nvmfpid=3116763 00:22:51.948 19:29:38 -- nvmf/common.sh@471 -- # waitforlisten 3116763 00:22:51.948 19:29:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:22:51.948 19:29:38 -- common/autotest_common.sh@817 -- # '[' -z 3116763 ']' 00:22:51.948 19:29:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:51.948 19:29:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:51.948 19:29:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:51.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:51.948 19:29:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:51.948 19:29:38 -- common/autotest_common.sh@10 -- # set +x 00:22:52.207 [2024-04-24 19:29:38.976114] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:52.207 [2024-04-24 19:29:38.976165] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:52.207 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.207 [2024-04-24 19:29:39.060455] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:52.207 [2024-04-24 19:29:39.147562] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:52.207 [2024-04-24 19:29:39.147605] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:52.207 [2024-04-24 19:29:39.147616] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:52.207 [2024-04-24 19:29:39.147624] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:52.207 [2024-04-24 19:29:39.147631] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:52.207 [2024-04-24 19:29:39.147708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:22:52.207 [2024-04-24 19:29:39.147809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:22:52.207 [2024-04-24 19:29:39.147909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:52.207 [2024-04-24 19:29:39.147910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:22:52.772 19:29:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:52.772 19:29:39 -- common/autotest_common.sh@850 -- # return 0 00:22:52.772 19:29:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:52.772 19:29:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:52.772 19:29:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 19:29:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:53.031 19:29:39 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:53.031 19:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.031 19:29:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 Malloc0 00:22:53.031 19:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.031 19:29:39 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:22:53.031 19:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.031 19:29:39 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 [2024-04-24 19:29:39.882770] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19201e0/0x192bf40) succeed. 00:22:53.031 [2024-04-24 19:29:39.893653] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1921820/0x19cc040) succeed. 00:22:53.031 19:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.031 19:29:40 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:53.031 19:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.031 19:29:40 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 19:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.031 19:29:40 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:53.031 19:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.031 19:29:40 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 19:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.031 19:29:40 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:53.031 19:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.031 19:29:40 -- common/autotest_common.sh@10 -- # set +x 00:22:53.031 [2024-04-24 19:29:40.050835] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:53.290 19:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.290 19:29:40 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:53.290 19:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.290 19:29:40 -- common/autotest_common.sh@10 -- # set +x 00:22:53.290 19:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.290 19:29:40 -- host/target_disconnect.sh@50 -- # reconnectpid=3116959 00:22:53.290 19:29:40 -- host/target_disconnect.sh@52 -- # sleep 2 00:22:53.290 19:29:40 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:22:53.290 EAL: No free 2048 kB hugepages reported on node 1 00:22:55.194 19:29:42 -- host/target_disconnect.sh@53 -- # kill -9 3116763 00:22:55.194 19:29:42 -- host/target_disconnect.sh@55 -- # sleep 2 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Read completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 Write completed with error (sct=0, sc=8) 00:22:56.570 starting I/O failed 00:22:56.570 [2024-04-24 19:29:43.256888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:57.138 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3116763 Killed "${NVMF_APP[@]}" "$@" 00:22:57.138 19:29:44 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:22:57.138 19:29:44 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:22:57.138 19:29:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:57.138 19:29:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:57.138 19:29:44 -- common/autotest_common.sh@10 -- # set +x 00:22:57.138 19:29:44 -- nvmf/common.sh@470 -- # nvmfpid=3117511 00:22:57.138 19:29:44 -- nvmf/common.sh@471 -- # waitforlisten 3117511 00:22:57.138 19:29:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:22:57.138 19:29:44 -- common/autotest_common.sh@817 -- # '[' -z 3117511 ']' 00:22:57.138 19:29:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.138 19:29:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:57.138 19:29:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.138 19:29:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:57.138 19:29:44 -- common/autotest_common.sh@10 -- # set +x 00:22:57.138 [2024-04-24 19:29:44.133318] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:22:57.138 [2024-04-24 19:29:44.133366] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.397 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.397 [2024-04-24 19:29:44.222812] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Read completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 Write completed with error (sct=0, sc=8) 00:22:57.397 starting I/O failed 00:22:57.397 [2024-04-24 19:29:44.261843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:57.397 [2024-04-24 19:29:44.308980] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.397 [2024-04-24 19:29:44.309024] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.397 [2024-04-24 19:29:44.309035] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:57.397 [2024-04-24 19:29:44.309044] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:57.397 [2024-04-24 19:29:44.309051] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.397 [2024-04-24 19:29:44.309136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:22:57.397 [2024-04-24 19:29:44.309228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:22:57.397 [2024-04-24 19:29:44.309327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:57.397 [2024-04-24 19:29:44.309328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:22:57.962 19:29:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:57.962 19:29:44 -- common/autotest_common.sh@850 -- # return 0 00:22:57.962 19:29:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:57.962 19:29:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:57.962 19:29:44 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 19:29:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.219 19:29:45 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 Malloc0 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 [2024-04-24 19:29:45.052479] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13581e0/0x1363f40) succeed. 00:22:58.219 [2024-04-24 19:29:45.063540] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1359820/0x1404040) succeed. 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 [2024-04-24 19:29:45.216779] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:58.219 19:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.219 19:29:45 -- common/autotest_common.sh@10 -- # set +x 00:22:58.219 19:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.219 19:29:45 -- host/target_disconnect.sh@58 -- # wait 3116959 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Write completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 Read completed with error (sct=0, sc=8) 00:22:58.477 starting I/O failed 00:22:58.477 [2024-04-24 19:29:45.266982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 [2024-04-24 19:29:45.270644] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.270706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.270729] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.270740] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.270749] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.477 [2024-04-24 19:29:45.280985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 qpair failed and we were unable to recover it. 00:22:58.477 [2024-04-24 19:29:45.290706] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.290744] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.290764] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.290774] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.290784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.477 [2024-04-24 19:29:45.300985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 qpair failed and we were unable to recover it. 00:22:58.477 [2024-04-24 19:29:45.310746] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.310788] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.310807] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.310817] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.310826] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.477 [2024-04-24 19:29:45.321086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 qpair failed and we were unable to recover it. 00:22:58.477 [2024-04-24 19:29:45.330770] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.330814] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.330832] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.330842] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.330851] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.477 [2024-04-24 19:29:45.341120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 qpair failed and we were unable to recover it. 00:22:58.477 [2024-04-24 19:29:45.350840] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.350889] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.350907] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.350917] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.350926] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.477 [2024-04-24 19:29:45.361274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.477 qpair failed and we were unable to recover it. 00:22:58.477 [2024-04-24 19:29:45.370772] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.477 [2024-04-24 19:29:45.370813] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.477 [2024-04-24 19:29:45.370834] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.477 [2024-04-24 19:29:45.370844] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.477 [2024-04-24 19:29:45.370853] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.381397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.390957] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.390997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.391015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.391025] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.391033] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.401256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.410998] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.411040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.411058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.411068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.411077] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.421341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.431068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.431113] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.431131] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.431141] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.431150] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.441473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.451083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.451122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.451140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.451150] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.451160] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.461505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.471211] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.471251] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.471269] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.471279] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.471288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.478 [2024-04-24 19:29:45.481685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.478 qpair failed and we were unable to recover it. 00:22:58.478 [2024-04-24 19:29:45.491213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.478 [2024-04-24 19:29:45.491254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.478 [2024-04-24 19:29:45.491270] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.478 [2024-04-24 19:29:45.491281] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.478 [2024-04-24 19:29:45.491290] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.501630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.511233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.511273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.511291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.511301] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.511310] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.521668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.531350] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.531387] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.531405] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.531415] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.531424] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.541595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.551445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.551487] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.551504] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.551514] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.551523] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.561873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.571467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.571509] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.571528] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.571538] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.571547] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.581909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.591624] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.591669] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.591687] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.591697] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.591706] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.601978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.611511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.611556] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.611575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.611585] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.611594] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.621814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.631703] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.631744] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.631762] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.631776] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.631784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.641842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.736 qpair failed and we were unable to recover it. 00:22:58.736 [2024-04-24 19:29:45.651693] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.736 [2024-04-24 19:29:45.651735] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.736 [2024-04-24 19:29:45.651753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.736 [2024-04-24 19:29:45.651763] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.736 [2024-04-24 19:29:45.651772] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.736 [2024-04-24 19:29:45.662093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.737 qpair failed and we were unable to recover it. 00:22:58.737 [2024-04-24 19:29:45.671745] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.737 [2024-04-24 19:29:45.671791] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.737 [2024-04-24 19:29:45.671809] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.737 [2024-04-24 19:29:45.671819] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.737 [2024-04-24 19:29:45.671828] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.737 [2024-04-24 19:29:45.682137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.737 qpair failed and we were unable to recover it. 00:22:58.737 [2024-04-24 19:29:45.691812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.737 [2024-04-24 19:29:45.691847] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.737 [2024-04-24 19:29:45.691864] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.737 [2024-04-24 19:29:45.691874] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.737 [2024-04-24 19:29:45.691883] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.737 [2024-04-24 19:29:45.702180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.737 qpair failed and we were unable to recover it. 00:22:58.737 [2024-04-24 19:29:45.711930] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.737 [2024-04-24 19:29:45.711969] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.737 [2024-04-24 19:29:45.711986] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.737 [2024-04-24 19:29:45.711996] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.737 [2024-04-24 19:29:45.712005] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.737 [2024-04-24 19:29:45.722119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.737 qpair failed and we were unable to recover it. 00:22:58.737 [2024-04-24 19:29:45.731911] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.737 [2024-04-24 19:29:45.731951] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.737 [2024-04-24 19:29:45.731968] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.737 [2024-04-24 19:29:45.731978] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.737 [2024-04-24 19:29:45.731987] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.737 [2024-04-24 19:29:45.742353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.737 qpair failed and we were unable to recover it. 00:22:58.737 [2024-04-24 19:29:45.752068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.737 [2024-04-24 19:29:45.752116] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.737 [2024-04-24 19:29:45.752134] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.737 [2024-04-24 19:29:45.752143] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.737 [2024-04-24 19:29:45.752152] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.762361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.772033] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.772073] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.772091] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.772101] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.772110] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.782595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.792084] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.792130] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.792147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.792158] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.792167] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.802359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.812213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.812253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.812273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.812283] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.812291] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.822568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.832226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.832273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.832290] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.832300] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.832308] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.842537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.852177] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.852216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.852233] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.852243] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.852251] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.862733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.872318] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.872357] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.872375] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.872384] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.872393] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.882794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.892349] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.892390] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.892407] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.892417] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.892425] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.902692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.912397] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.912444] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.912462] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.912472] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.912480] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.922742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.932541] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.932578] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.932597] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.932607] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.932616] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.942775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.995 qpair failed and we were unable to recover it. 00:22:58.995 [2024-04-24 19:29:45.952567] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.995 [2024-04-24 19:29:45.952601] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.995 [2024-04-24 19:29:45.952618] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.995 [2024-04-24 19:29:45.952628] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.995 [2024-04-24 19:29:45.952637] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.995 [2024-04-24 19:29:45.963009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.996 qpair failed and we were unable to recover it. 00:22:58.996 [2024-04-24 19:29:45.972627] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.996 [2024-04-24 19:29:45.972667] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.996 [2024-04-24 19:29:45.972684] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.996 [2024-04-24 19:29:45.972694] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.996 [2024-04-24 19:29:45.972703] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.996 [2024-04-24 19:29:45.982976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.996 qpair failed and we were unable to recover it. 00:22:58.996 [2024-04-24 19:29:45.992731] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.996 [2024-04-24 19:29:45.992776] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.996 [2024-04-24 19:29:45.992793] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.996 [2024-04-24 19:29:45.992803] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.996 [2024-04-24 19:29:45.992811] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:58.996 [2024-04-24 19:29:46.003018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.996 qpair failed and we were unable to recover it. 00:22:58.996 [2024-04-24 19:29:46.012762] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:58.996 [2024-04-24 19:29:46.012807] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:58.996 [2024-04-24 19:29:46.012825] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:58.996 [2024-04-24 19:29:46.012836] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:58.996 [2024-04-24 19:29:46.012846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.253 [2024-04-24 19:29:46.023070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.253 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.032808] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.032844] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.032861] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.032871] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.032880] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.043347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.052840] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.052879] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.052896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.052906] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.052914] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.063210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.072962] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.073004] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.073021] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.073034] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.073042] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.083270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.093060] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.093097] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.093115] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.093124] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.093133] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.103384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.113087] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.113126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.113143] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.113153] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.113161] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.123400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.133187] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.133226] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.133243] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.133253] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.133262] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.143442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.153261] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.153307] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.153324] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.153334] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.153343] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.163597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.173379] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.173417] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.173434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.173444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.173453] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.183604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.193320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.193354] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.193372] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.193382] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.193390] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.203544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.213397] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.213438] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.213456] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.213466] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.213475] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.223797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.233408] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.233452] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.233469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.233478] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.233487] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.243727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.253489] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.253531] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.253556] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.253566] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.253575] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.254 [2024-04-24 19:29:46.263787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.254 qpair failed and we were unable to recover it. 00:22:59.254 [2024-04-24 19:29:46.273494] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.254 [2024-04-24 19:29:46.273532] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.254 [2024-04-24 19:29:46.273555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.254 [2024-04-24 19:29:46.273565] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.254 [2024-04-24 19:29:46.273574] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.283816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.293558] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.293604] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.293621] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.293631] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.293640] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.304057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.313658] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.313709] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.313727] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.313737] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.313746] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.323898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.333702] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.333748] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.333766] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.333776] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.333784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.344075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.353725] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.353762] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.353779] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.353789] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.353798] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.364056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.373730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.373769] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.373787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.373797] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.373806] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.384149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.393881] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.393925] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.393942] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.393952] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.393961] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.404077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.512 [2024-04-24 19:29:46.413973] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.512 [2024-04-24 19:29:46.414011] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.512 [2024-04-24 19:29:46.414028] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.512 [2024-04-24 19:29:46.414038] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.512 [2024-04-24 19:29:46.414047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.512 [2024-04-24 19:29:46.424279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.512 qpair failed and we were unable to recover it. 00:22:59.513 [2024-04-24 19:29:46.433949] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.513 [2024-04-24 19:29:46.433993] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.513 [2024-04-24 19:29:46.434010] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.513 [2024-04-24 19:29:46.434020] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.513 [2024-04-24 19:29:46.434029] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.513 [2024-04-24 19:29:46.444233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.513 qpair failed and we were unable to recover it. 00:22:59.513 [2024-04-24 19:29:46.454060] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.513 [2024-04-24 19:29:46.454101] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.513 [2024-04-24 19:29:46.454118] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.513 [2024-04-24 19:29:46.454128] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.513 [2024-04-24 19:29:46.454137] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.513 [2024-04-24 19:29:46.464355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.513 qpair failed and we were unable to recover it. 00:22:59.513 [2024-04-24 19:29:46.474078] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.513 [2024-04-24 19:29:46.474122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.513 [2024-04-24 19:29:46.474138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.513 [2024-04-24 19:29:46.474148] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.513 [2024-04-24 19:29:46.474157] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.513 [2024-04-24 19:29:46.484512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.513 qpair failed and we were unable to recover it. 00:22:59.513 [2024-04-24 19:29:46.494090] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.513 [2024-04-24 19:29:46.494136] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.513 [2024-04-24 19:29:46.494153] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.513 [2024-04-24 19:29:46.494163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.513 [2024-04-24 19:29:46.494172] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.513 [2024-04-24 19:29:46.504497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.513 qpair failed and we were unable to recover it. 00:22:59.513 [2024-04-24 19:29:46.514118] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.513 [2024-04-24 19:29:46.514155] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.513 [2024-04-24 19:29:46.514178] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.513 [2024-04-24 19:29:46.514194] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.513 [2024-04-24 19:29:46.514204] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.513 [2024-04-24 19:29:46.524556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.513 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.534210] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.534251] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.534268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.534277] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.534286] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.544676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.554240] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.554288] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.554306] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.554316] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.554325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.564748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.574277] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.574320] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.574337] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.574348] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.574356] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.584707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.594339] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.594377] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.594395] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.594405] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.594413] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.604717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.614460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.614499] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.614516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.614527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.614535] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.624803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.634519] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.634564] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.634580] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.634590] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.634598] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.644737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.654612] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.654650] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.654667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.654677] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.654686] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.665026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.674785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.674823] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.674841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.674851] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.674859] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.685018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.694676] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.694716] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.694736] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.694746] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.694755] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.704931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.714782] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.714828] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.771 [2024-04-24 19:29:46.714845] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.771 [2024-04-24 19:29:46.714855] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.771 [2024-04-24 19:29:46.714864] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.771 [2024-04-24 19:29:46.725373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.771 qpair failed and we were unable to recover it. 00:22:59.771 [2024-04-24 19:29:46.734923] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.771 [2024-04-24 19:29:46.734957] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.772 [2024-04-24 19:29:46.734975] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.772 [2024-04-24 19:29:46.734985] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.772 [2024-04-24 19:29:46.734993] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.772 [2024-04-24 19:29:46.745263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.772 qpair failed and we were unable to recover it. 00:22:59.772 [2024-04-24 19:29:46.754895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.772 [2024-04-24 19:29:46.754936] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.772 [2024-04-24 19:29:46.754954] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.772 [2024-04-24 19:29:46.754964] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.772 [2024-04-24 19:29:46.754973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.772 [2024-04-24 19:29:46.765307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.772 qpair failed and we were unable to recover it. 00:22:59.772 [2024-04-24 19:29:46.774926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:22:59.772 [2024-04-24 19:29:46.774964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:22:59.772 [2024-04-24 19:29:46.774981] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:22:59.772 [2024-04-24 19:29:46.774991] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:22:59.772 [2024-04-24 19:29:46.775000] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:22:59.772 [2024-04-24 19:29:46.785266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:59.772 qpair failed and we were unable to recover it. 00:23:00.029 [2024-04-24 19:29:46.795116] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.029 [2024-04-24 19:29:46.795166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.029 [2024-04-24 19:29:46.795184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.029 [2024-04-24 19:29:46.795194] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.029 [2024-04-24 19:29:46.795204] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.029 [2024-04-24 19:29:46.805472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.029 qpair failed and we were unable to recover it. 00:23:00.029 [2024-04-24 19:29:46.815064] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.029 [2024-04-24 19:29:46.815103] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.029 [2024-04-24 19:29:46.815119] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.029 [2024-04-24 19:29:46.815129] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.029 [2024-04-24 19:29:46.815138] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.029 [2024-04-24 19:29:46.825351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.029 qpair failed and we were unable to recover it. 00:23:00.029 [2024-04-24 19:29:46.835193] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.029 [2024-04-24 19:29:46.835231] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.029 [2024-04-24 19:29:46.835249] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.029 [2024-04-24 19:29:46.835260] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.029 [2024-04-24 19:29:46.835269] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.029 [2024-04-24 19:29:46.845545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.029 qpair failed and we were unable to recover it. 00:23:00.029 [2024-04-24 19:29:46.855251] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.855289] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.855307] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.855317] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.855327] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.865539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.875264] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.875315] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.875332] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.875341] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.875350] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.885746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.895386] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.895422] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.895438] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.895448] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.895457] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.905697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.915354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.915392] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.915410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.915420] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.915428] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.925777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.935495] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.935534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.935554] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.935565] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.935574] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.945853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.955496] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.955539] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.955560] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.955573] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.955582] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.965671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.975530] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.975570] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.975587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.975597] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.975606] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:46.985953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:46.995613] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:46.995650] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:46.995667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:46.995677] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:46.995686] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:47.005876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:47.015633] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:47.015671] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:47.015689] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:47.015699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:47.015708] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:47.026136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.030 [2024-04-24 19:29:47.035763] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.030 [2024-04-24 19:29:47.035810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.030 [2024-04-24 19:29:47.035828] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.030 [2024-04-24 19:29:47.035837] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.030 [2024-04-24 19:29:47.035846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.030 [2024-04-24 19:29:47.046218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.030 qpair failed and we were unable to recover it. 00:23:00.287 [2024-04-24 19:29:47.055928] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.287 [2024-04-24 19:29:47.055961] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.287 [2024-04-24 19:29:47.055978] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.287 [2024-04-24 19:29:47.055988] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.287 [2024-04-24 19:29:47.055997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.287 [2024-04-24 19:29:47.066207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.075866] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.075899] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.075916] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.075926] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.075935] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.086227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.095864] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.095902] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.095918] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.095929] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.095937] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.106299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.115903] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.115945] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.115962] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.115972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.115981] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.126262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.136018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.136058] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.136080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.136090] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.136098] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.146388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.156081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.156114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.156131] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.156141] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.156150] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.166490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.176159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.176199] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.176217] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.176227] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.176236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.186444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.196252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.196294] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.196311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.196321] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.196330] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.206656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.216157] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.216198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.216215] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.216225] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.216234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.226650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.236383] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.236423] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.236440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.236450] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.236459] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.246679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.256298] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.256340] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.256357] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.256367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.256376] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.266529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.276399] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.276445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.276462] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.276472] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.276481] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.286702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.288 [2024-04-24 19:29:47.296442] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.288 [2024-04-24 19:29:47.296477] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.288 [2024-04-24 19:29:47.296494] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.288 [2024-04-24 19:29:47.296504] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.288 [2024-04-24 19:29:47.296513] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.288 [2024-04-24 19:29:47.306874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.288 qpair failed and we were unable to recover it. 00:23:00.545 [2024-04-24 19:29:47.316557] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.545 [2024-04-24 19:29:47.316599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.545 [2024-04-24 19:29:47.316616] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.545 [2024-04-24 19:29:47.316625] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.545 [2024-04-24 19:29:47.316634] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.545 [2024-04-24 19:29:47.326882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.545 qpair failed and we were unable to recover it. 00:23:00.545 [2024-04-24 19:29:47.336595] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.336635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.336652] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.336662] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.336671] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.347010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.356601] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.356646] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.356663] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.356673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.356681] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.367126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.376692] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.376731] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.376749] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.376759] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.376767] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.386981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.396784] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.396824] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.396841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.396853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.396862] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.407183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.416673] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.416713] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.416730] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.416740] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.416749] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.427178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.436834] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.436879] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.436897] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.436907] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.436916] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.447240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.456947] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.456990] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.457007] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.457017] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.457026] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.467238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.477018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.477056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.477073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.477083] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.477092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.487294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.496999] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.497038] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.497055] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.497066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.497074] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.507480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.517043] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.517086] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.517103] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.517113] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.517122] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.527504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.537147] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.537181] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.537198] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.537208] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.537216] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.546 [2024-04-24 19:29:47.547544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.546 qpair failed and we were unable to recover it. 00:23:00.546 [2024-04-24 19:29:47.557194] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.546 [2024-04-24 19:29:47.557234] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.546 [2024-04-24 19:29:47.557251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.546 [2024-04-24 19:29:47.557261] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.546 [2024-04-24 19:29:47.557269] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.567719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.577256] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.577296] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.577317] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.577328] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.577336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.587611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.597365] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.597410] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.597427] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.597438] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.597447] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.607878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.617266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.617304] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.617321] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.617331] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.617340] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.627736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.637461] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.637498] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.637516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.637526] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.637535] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.647958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.657577] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.657615] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.657633] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.657643] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.657652] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.667892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.677613] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.677659] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.677676] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.677686] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.677695] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.687873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.697695] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.697739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.803 [2024-04-24 19:29:47.697756] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.803 [2024-04-24 19:29:47.697766] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.803 [2024-04-24 19:29:47.697775] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.803 [2024-04-24 19:29:47.707990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.803 qpair failed and we were unable to recover it. 00:23:00.803 [2024-04-24 19:29:47.717726] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.803 [2024-04-24 19:29:47.717766] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.717783] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.717794] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.717803] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.804 [2024-04-24 19:29:47.728017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.804 qpair failed and we were unable to recover it. 00:23:00.804 [2024-04-24 19:29:47.737731] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.804 [2024-04-24 19:29:47.737773] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.737790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.737800] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.737809] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.804 [2024-04-24 19:29:47.748309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.804 qpair failed and we were unable to recover it. 00:23:00.804 [2024-04-24 19:29:47.757911] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.804 [2024-04-24 19:29:47.757964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.757983] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.757993] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.758002] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.804 [2024-04-24 19:29:47.768172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.804 qpair failed and we were unable to recover it. 00:23:00.804 [2024-04-24 19:29:47.778004] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.804 [2024-04-24 19:29:47.778045] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.778062] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.778072] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.778080] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.804 [2024-04-24 19:29:47.788219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.804 qpair failed and we were unable to recover it. 00:23:00.804 [2024-04-24 19:29:47.798087] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.804 [2024-04-24 19:29:47.798128] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.798146] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.798156] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.798164] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:00.804 [2024-04-24 19:29:47.808454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:00.804 qpair failed and we were unable to recover it. 00:23:00.804 [2024-04-24 19:29:47.818041] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:00.804 [2024-04-24 19:29:47.818079] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:00.804 [2024-04-24 19:29:47.818096] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:00.804 [2024-04-24 19:29:47.818106] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:00.804 [2024-04-24 19:29:47.818115] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.111 [2024-04-24 19:29:47.828225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.111 qpair failed and we were unable to recover it. 00:23:01.111 [2024-04-24 19:29:47.838175] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.111 [2024-04-24 19:29:47.838225] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.111 [2024-04-24 19:29:47.838242] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.111 [2024-04-24 19:29:47.838255] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.111 [2024-04-24 19:29:47.838264] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.111 [2024-04-24 19:29:47.848455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.111 qpair failed and we were unable to recover it. 00:23:01.111 [2024-04-24 19:29:47.858165] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.111 [2024-04-24 19:29:47.858201] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.111 [2024-04-24 19:29:47.858218] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.111 [2024-04-24 19:29:47.858228] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.111 [2024-04-24 19:29:47.858237] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.111 [2024-04-24 19:29:47.868367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.111 qpair failed and we were unable to recover it. 00:23:01.111 [2024-04-24 19:29:47.878268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.111 [2024-04-24 19:29:47.878306] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.878323] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.878333] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.878342] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.888611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.898243] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.898282] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.898299] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.898309] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.898318] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.908569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.918335] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.918384] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.918401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.918412] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.918421] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.928650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.938426] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.938469] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.938486] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.938497] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.938506] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.948651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.958416] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.958452] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.958469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.958479] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.958488] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.968754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.978493] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.978532] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.978555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.978566] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.978575] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:47.988658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:47.998554] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:47.998594] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:47.998612] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:47.998622] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:47.998630] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:48.008950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:48.018582] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:48.018617] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:48.018638] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:48.018648] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:48.018657] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:48.028830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:48.038690] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:48.038727] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:48.038745] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:48.038754] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:48.038763] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:48.049091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:48.058702] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:48.058740] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:48.058758] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:48.058768] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:48.058776] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:48.069056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:48.078818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:48.078862] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.112 [2024-04-24 19:29:48.078878] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.112 [2024-04-24 19:29:48.078888] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.112 [2024-04-24 19:29:48.078896] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.112 [2024-04-24 19:29:48.088922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.112 qpair failed and we were unable to recover it. 00:23:01.112 [2024-04-24 19:29:48.098818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.112 [2024-04-24 19:29:48.098860] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.113 [2024-04-24 19:29:48.098877] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.113 [2024-04-24 19:29:48.098887] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.113 [2024-04-24 19:29:48.098896] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.113 [2024-04-24 19:29:48.109127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.113 qpair failed and we were unable to recover it. 00:23:01.113 [2024-04-24 19:29:48.118961] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.113 [2024-04-24 19:29:48.118996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.113 [2024-04-24 19:29:48.119013] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.113 [2024-04-24 19:29:48.119023] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.113 [2024-04-24 19:29:48.119032] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.113 [2024-04-24 19:29:48.129206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.113 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.138867] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.138906] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.138923] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.138933] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.138942] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.149136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.158960] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.159001] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.159018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.159028] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.159037] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.169379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.179288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.179326] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.179343] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.179353] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.179362] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.189578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.199245] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.199284] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.199301] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.199311] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.199319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.209447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.219219] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.219271] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.219289] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.219299] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.219308] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.229441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.239266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.239312] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.239329] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.239338] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.239347] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.249517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.259227] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.259262] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.259280] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.259290] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.259299] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.370 [2024-04-24 19:29:48.269792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.370 qpair failed and we were unable to recover it. 00:23:01.370 [2024-04-24 19:29:48.279329] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.370 [2024-04-24 19:29:48.279365] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.370 [2024-04-24 19:29:48.279382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.370 [2024-04-24 19:29:48.279395] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.370 [2024-04-24 19:29:48.279404] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.289768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.371 [2024-04-24 19:29:48.299374] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.371 [2024-04-24 19:29:48.299413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.371 [2024-04-24 19:29:48.299430] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.371 [2024-04-24 19:29:48.299440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.371 [2024-04-24 19:29:48.299448] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.309827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.371 [2024-04-24 19:29:48.319440] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.371 [2024-04-24 19:29:48.319484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.371 [2024-04-24 19:29:48.319500] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.371 [2024-04-24 19:29:48.319510] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.371 [2024-04-24 19:29:48.319519] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.329796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.371 [2024-04-24 19:29:48.339555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.371 [2024-04-24 19:29:48.339592] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.371 [2024-04-24 19:29:48.339609] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.371 [2024-04-24 19:29:48.339619] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.371 [2024-04-24 19:29:48.339628] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.349946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.371 [2024-04-24 19:29:48.359697] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.371 [2024-04-24 19:29:48.359736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.371 [2024-04-24 19:29:48.359753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.371 [2024-04-24 19:29:48.359763] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.371 [2024-04-24 19:29:48.359772] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.369940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.371 [2024-04-24 19:29:48.379732] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.371 [2024-04-24 19:29:48.379773] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.371 [2024-04-24 19:29:48.379790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.371 [2024-04-24 19:29:48.379799] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.371 [2024-04-24 19:29:48.379808] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.371 [2024-04-24 19:29:48.390013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.371 qpair failed and we were unable to recover it. 00:23:01.628 [2024-04-24 19:29:48.399698] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.628 [2024-04-24 19:29:48.399736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.628 [2024-04-24 19:29:48.399753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.628 [2024-04-24 19:29:48.399762] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.628 [2024-04-24 19:29:48.399771] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.628 [2024-04-24 19:29:48.410125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.628 qpair failed and we were unable to recover it. 00:23:01.628 [2024-04-24 19:29:48.419716] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.628 [2024-04-24 19:29:48.419755] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.628 [2024-04-24 19:29:48.419773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.628 [2024-04-24 19:29:48.419783] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.419792] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.430118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.439774] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.439813] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.439830] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.439840] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.439849] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.450382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.459935] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.459975] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.459995] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.460005] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.460014] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.470299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.482051] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.482098] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.482115] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.482125] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.482135] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.490445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.500207] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.500247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.500264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.500274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.500283] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.510498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.520226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.520265] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.520282] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.520292] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.520301] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.530712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.540303] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.540342] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.540360] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.540370] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.540379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.550630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.560233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.560273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.560291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.560301] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.560310] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.570715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.580342] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.580389] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.580406] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.580416] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.580424] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.590774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.600420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.600461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.600477] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.600487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.600496] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.610622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.620421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.620461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.620478] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.620488] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.620497] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.629 [2024-04-24 19:29:48.630933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.629 qpair failed and we were unable to recover it. 00:23:01.629 [2024-04-24 19:29:48.640583] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.629 [2024-04-24 19:29:48.640635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.629 [2024-04-24 19:29:48.640652] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.629 [2024-04-24 19:29:48.640662] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.629 [2024-04-24 19:29:48.640671] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.650958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.660643] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.660688] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.887 [2024-04-24 19:29:48.660706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.887 [2024-04-24 19:29:48.660716] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.887 [2024-04-24 19:29:48.660725] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.671025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.680762] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.680800] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.887 [2024-04-24 19:29:48.680817] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.887 [2024-04-24 19:29:48.680827] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.887 [2024-04-24 19:29:48.680836] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.691049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.700666] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.700706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.887 [2024-04-24 19:29:48.700724] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.887 [2024-04-24 19:29:48.700734] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.887 [2024-04-24 19:29:48.700743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.711200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.720827] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.720868] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.887 [2024-04-24 19:29:48.720886] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.887 [2024-04-24 19:29:48.720899] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.887 [2024-04-24 19:29:48.720908] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.731323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.740828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.740867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.887 [2024-04-24 19:29:48.740884] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.887 [2024-04-24 19:29:48.740894] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.887 [2024-04-24 19:29:48.740903] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.887 [2024-04-24 19:29:48.751180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.887 qpair failed and we were unable to recover it. 00:23:01.887 [2024-04-24 19:29:48.760907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.887 [2024-04-24 19:29:48.760942] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.760959] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.760969] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.760977] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.771368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.781091] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.781132] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.781149] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.781159] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.781168] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.791307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.801031] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.801070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.801087] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.801097] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.801106] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.811367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.821069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.821108] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.821125] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.821135] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.821144] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.831592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.841180] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.841221] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.841239] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.841248] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.841257] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.851569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.861219] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.861258] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.861275] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.861285] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.861293] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.871637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.881323] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.881367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.881384] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.881394] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.881402] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:01.888 [2024-04-24 19:29:48.891622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:01.888 qpair failed and we were unable to recover it. 00:23:01.888 [2024-04-24 19:29:48.901259] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:01.888 [2024-04-24 19:29:48.901301] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:01.888 [2024-04-24 19:29:48.901320] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:01.888 [2024-04-24 19:29:48.901330] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:01.888 [2024-04-24 19:29:48.901339] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:48.911827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:48.921335] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.146 [2024-04-24 19:29:48.921372] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.146 [2024-04-24 19:29:48.921389] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.146 [2024-04-24 19:29:48.921399] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.146 [2024-04-24 19:29:48.921408] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:48.931690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:48.941396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.146 [2024-04-24 19:29:48.941433] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.146 [2024-04-24 19:29:48.941450] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.146 [2024-04-24 19:29:48.941460] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.146 [2024-04-24 19:29:48.941469] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:48.951957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:48.961490] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.146 [2024-04-24 19:29:48.961530] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.146 [2024-04-24 19:29:48.961547] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.146 [2024-04-24 19:29:48.961567] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.146 [2024-04-24 19:29:48.961576] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:48.971942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:48.981667] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.146 [2024-04-24 19:29:48.981709] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.146 [2024-04-24 19:29:48.981726] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.146 [2024-04-24 19:29:48.981736] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.146 [2024-04-24 19:29:48.981745] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:48.992035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:49.001689] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.146 [2024-04-24 19:29:49.001724] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.146 [2024-04-24 19:29:49.001741] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.146 [2024-04-24 19:29:49.001752] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.146 [2024-04-24 19:29:49.001761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.146 [2024-04-24 19:29:49.011870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.146 qpair failed and we were unable to recover it. 00:23:02.146 [2024-04-24 19:29:49.021597] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.021634] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.021651] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.021661] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.021670] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.032194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.041801] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.041848] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.041865] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.041875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.041883] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.052593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.061725] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.061766] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.061783] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.061793] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.061802] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.072006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.081761] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.081810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.081828] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.081838] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.081846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.092280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.101875] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.101917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.101934] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.101944] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.101952] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.112252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.121995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.122044] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.122061] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.122071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.122080] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.132193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.141852] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.141892] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.141909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.141919] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.141928] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.147 [2024-04-24 19:29:49.152486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.147 qpair failed and we were unable to recover it. 00:23:02.147 [2024-04-24 19:29:49.162043] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.147 [2024-04-24 19:29:49.162082] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.147 [2024-04-24 19:29:49.162099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.147 [2024-04-24 19:29:49.162112] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.147 [2024-04-24 19:29:49.162121] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.405 [2024-04-24 19:29:49.172341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.405 qpair failed and we were unable to recover it. 00:23:02.405 [2024-04-24 19:29:49.182130] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.405 [2024-04-24 19:29:49.182172] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.405 [2024-04-24 19:29:49.182189] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.405 [2024-04-24 19:29:49.182199] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.405 [2024-04-24 19:29:49.182207] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.405 [2024-04-24 19:29:49.192317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.405 qpair failed and we were unable to recover it. 00:23:02.405 [2024-04-24 19:29:49.202081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.405 [2024-04-24 19:29:49.202129] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.405 [2024-04-24 19:29:49.202146] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.405 [2024-04-24 19:29:49.202156] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.405 [2024-04-24 19:29:49.202165] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.405 [2024-04-24 19:29:49.212455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.405 qpair failed and we were unable to recover it. 00:23:02.405 [2024-04-24 19:29:49.222144] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.405 [2024-04-24 19:29:49.222185] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.405 [2024-04-24 19:29:49.222202] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.405 [2024-04-24 19:29:49.222212] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.405 [2024-04-24 19:29:49.222221] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.405 [2024-04-24 19:29:49.232669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.405 qpair failed and we were unable to recover it. 00:23:02.405 [2024-04-24 19:29:49.242266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.405 [2024-04-24 19:29:49.242306] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.405 [2024-04-24 19:29:49.242322] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.405 [2024-04-24 19:29:49.242332] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.405 [2024-04-24 19:29:49.242341] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.405 [2024-04-24 19:29:49.252709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.405 qpair failed and we were unable to recover it. 00:23:02.405 [2024-04-24 19:29:49.262216] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.405 [2024-04-24 19:29:49.262258] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.405 [2024-04-24 19:29:49.262275] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.405 [2024-04-24 19:29:49.262285] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.405 [2024-04-24 19:29:49.262294] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.272712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.282396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.282445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.282462] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.282471] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.282480] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.292807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.302384] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.302418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.302434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.302444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.302453] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.312800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.322490] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.322534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.322563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.322573] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.322582] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.332887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.342508] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.342545] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.342574] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.342585] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.342593] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.352752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.362652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.362699] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.362715] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.362725] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.362734] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.372941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.382628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.382665] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.382682] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.382692] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.382701] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.393053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.402767] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.402802] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.402818] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.402828] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.402837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.406 [2024-04-24 19:29:49.413160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.406 qpair failed and we were unable to recover it. 00:23:02.406 [2024-04-24 19:29:49.422716] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.406 [2024-04-24 19:29:49.422756] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.406 [2024-04-24 19:29:49.422773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.406 [2024-04-24 19:29:49.422783] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.406 [2024-04-24 19:29:49.422792] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.664 [2024-04-24 19:29:49.433077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.664 qpair failed and we were unable to recover it. 00:23:02.664 [2024-04-24 19:29:49.442749] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.664 [2024-04-24 19:29:49.442789] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.664 [2024-04-24 19:29:49.442805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.664 [2024-04-24 19:29:49.442815] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.664 [2024-04-24 19:29:49.442824] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.664 [2024-04-24 19:29:49.453197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.664 qpair failed and we were unable to recover it. 00:23:02.664 [2024-04-24 19:29:49.462911] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.664 [2024-04-24 19:29:49.462952] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.664 [2024-04-24 19:29:49.462970] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.664 [2024-04-24 19:29:49.462980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.664 [2024-04-24 19:29:49.462988] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.664 [2024-04-24 19:29:49.473238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.664 qpair failed and we were unable to recover it. 00:23:02.664 [2024-04-24 19:29:49.482922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.664 [2024-04-24 19:29:49.482960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.664 [2024-04-24 19:29:49.482977] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.482987] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.482996] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.493379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.503097] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.503138] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.503156] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.503166] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.503175] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.513403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.523091] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.523142] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.523160] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.523170] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.523178] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.533573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.543228] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.543263] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.543281] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.543290] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.543299] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.553614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.563167] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.563209] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.563228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.563239] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.563247] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.573469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.583337] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.583377] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.583395] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.583404] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.583413] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.593728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.603416] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.603461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.603478] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.603491] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.603500] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.613641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.623470] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.623505] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.623523] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.623533] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.623541] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.633755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.643528] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.643572] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.643589] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.643599] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.643608] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.653840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.663488] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.663527] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.663544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.663559] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.663568] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.665 [2024-04-24 19:29:49.673861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.665 qpair failed and we were unable to recover it. 00:23:02.665 [2024-04-24 19:29:49.683803] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.665 [2024-04-24 19:29:49.683850] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.665 [2024-04-24 19:29:49.683868] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.665 [2024-04-24 19:29:49.683878] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.665 [2024-04-24 19:29:49.683887] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.923 [2024-04-24 19:29:49.693847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.923 qpair failed and we were unable to recover it. 00:23:02.923 [2024-04-24 19:29:49.703669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.923 [2024-04-24 19:29:49.703709] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.923 [2024-04-24 19:29:49.703727] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.923 [2024-04-24 19:29:49.703737] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.923 [2024-04-24 19:29:49.703745] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.923 [2024-04-24 19:29:49.713900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.923 qpair failed and we were unable to recover it. 00:23:02.923 [2024-04-24 19:29:49.723788] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.923 [2024-04-24 19:29:49.723829] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.923 [2024-04-24 19:29:49.723846] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.923 [2024-04-24 19:29:49.723856] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.923 [2024-04-24 19:29:49.723865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.923 [2024-04-24 19:29:49.733994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.923 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.743794] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.743834] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.743852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.743862] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.743870] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.753890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.763797] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.763843] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.763860] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.763870] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.763878] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.774295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.783910] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.783951] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.783970] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.783980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.783989] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.794263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.804001] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.804034] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.804051] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.804061] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.804069] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.814346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.823922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.823961] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.823978] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.823988] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.823997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.834359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.844055] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.844097] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.844113] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.844123] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.844132] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.854380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.864307] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.864344] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.864361] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.864371] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.864379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.874418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.884249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.884288] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.884305] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.884315] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.884324] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.894558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.904146] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.904185] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.904203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.904213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.904222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.914546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:02.924 [2024-04-24 19:29:49.924284] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:02.924 [2024-04-24 19:29:49.924332] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:02.924 [2024-04-24 19:29:49.924349] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:02.924 [2024-04-24 19:29:49.924360] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:02.924 [2024-04-24 19:29:49.924368] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:02.924 [2024-04-24 19:29:49.934465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:02.924 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:49.944261] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:49.944295] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:49.944313] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:49.944323] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:49.944331] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:49.954777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:49.964281] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:49.964324] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:49.964342] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:49.964352] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:49.964361] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:49.974614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:49.984324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:49.984366] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:49.984383] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:49.984393] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:49.984402] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:49.994812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:50.004420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:50.004465] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:50.004484] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:50.004495] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:50.004505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:50.014786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:50.024535] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:50.024581] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:50.024599] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:50.024610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:50.024619] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:50.035032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:50.044664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:50.044708] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:50.044727] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:50.044741] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:50.044763] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:50.055087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:50.064673] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:50.064715] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:50.064732] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:50.064742] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:50.064751] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.182 [2024-04-24 19:29:50.075005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.182 qpair failed and we were unable to recover it. 00:23:03.182 [2024-04-24 19:29:50.084673] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.182 [2024-04-24 19:29:50.084722] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.182 [2024-04-24 19:29:50.084741] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.182 [2024-04-24 19:29:50.084752] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.182 [2024-04-24 19:29:50.084761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.095019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.183 [2024-04-24 19:29:50.104713] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.183 [2024-04-24 19:29:50.104750] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.183 [2024-04-24 19:29:50.104767] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.183 [2024-04-24 19:29:50.104779] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.183 [2024-04-24 19:29:50.104788] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.115078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.183 [2024-04-24 19:29:50.124698] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.183 [2024-04-24 19:29:50.124733] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.183 [2024-04-24 19:29:50.124750] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.183 [2024-04-24 19:29:50.124760] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.183 [2024-04-24 19:29:50.124769] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.135175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.183 [2024-04-24 19:29:50.144809] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.183 [2024-04-24 19:29:50.144848] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.183 [2024-04-24 19:29:50.144866] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.183 [2024-04-24 19:29:50.144876] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.183 [2024-04-24 19:29:50.144885] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.155230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.183 [2024-04-24 19:29:50.164898] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.183 [2024-04-24 19:29:50.164939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.183 [2024-04-24 19:29:50.164958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.183 [2024-04-24 19:29:50.164968] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.183 [2024-04-24 19:29:50.164977] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.175440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.183 [2024-04-24 19:29:50.185003] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.183 [2024-04-24 19:29:50.185040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.183 [2024-04-24 19:29:50.185058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.183 [2024-04-24 19:29:50.185067] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.183 [2024-04-24 19:29:50.185076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.183 [2024-04-24 19:29:50.195399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.183 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.205018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.205054] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.205072] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.205081] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.205090] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.441 [2024-04-24 19:29:50.215419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.441 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.225097] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.225137] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.225157] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.225167] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.225176] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.441 [2024-04-24 19:29:50.235463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.441 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.245117] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.245160] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.245176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.245186] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.245195] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.441 [2024-04-24 19:29:50.255452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.441 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.265197] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.265239] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.265255] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.265265] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.265274] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.441 [2024-04-24 19:29:50.275640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.441 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.285211] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.285252] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.285269] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.285279] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.285288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.441 [2024-04-24 19:29:50.295609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.441 qpair failed and we were unable to recover it. 00:23:03.441 [2024-04-24 19:29:50.305358] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.441 [2024-04-24 19:29:50.305398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.441 [2024-04-24 19:29:50.305415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.441 [2024-04-24 19:29:50.305425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.441 [2024-04-24 19:29:50.305434] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:03.442 [2024-04-24 19:29:50.315767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:03.442 qpair failed and we were unable to recover it. 00:23:03.442 [2024-04-24 19:29:50.315903] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:23:03.442 A controller has encountered a failure and is being reset. 00:23:03.442 [2024-04-24 19:29:50.325366] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.442 [2024-04-24 19:29:50.325415] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.442 [2024-04-24 19:29:50.325443] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.442 [2024-04-24 19:29:50.325458] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.442 [2024-04-24 19:29:50.325472] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:03.442 [2024-04-24 19:29:50.335776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:03.442 qpair failed and we were unable to recover it. 00:23:03.442 [2024-04-24 19:29:50.345396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:03.442 [2024-04-24 19:29:50.345430] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:03.442 [2024-04-24 19:29:50.345448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:03.442 [2024-04-24 19:29:50.345458] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:03.442 [2024-04-24 19:29:50.345467] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:03.442 [2024-04-24 19:29:50.355873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:03.442 qpair failed and we were unable to recover it. 00:23:03.442 [2024-04-24 19:29:50.356030] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:23:03.442 [2024-04-24 19:29:50.358224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:03.442 Controller properly reset. 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Read completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 Write completed with error (sct=0, sc=8) 00:23:04.402 starting I/O failed 00:23:04.402 [2024-04-24 19:29:51.380284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:04.402 Initializing NVMe Controllers 00:23:04.402 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.402 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.402 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:23:04.402 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:23:04.402 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:23:04.402 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:23:04.402 Initialization complete. Launching workers. 00:23:04.402 Starting thread on core 1 00:23:04.402 Starting thread on core 2 00:23:04.402 Starting thread on core 3 00:23:04.402 Starting thread on core 0 00:23:04.660 19:29:51 -- host/target_disconnect.sh@59 -- # sync 00:23:04.660 00:23:04.660 real 0m12.508s 00:23:04.660 user 0m26.900s 00:23:04.660 sys 0m3.349s 00:23:04.660 19:29:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:04.660 19:29:51 -- common/autotest_common.sh@10 -- # set +x 00:23:04.660 ************************************ 00:23:04.660 END TEST nvmf_target_disconnect_tc2 00:23:04.660 ************************************ 00:23:04.660 19:29:51 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:23:04.660 19:29:51 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:23:04.660 19:29:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:04.660 19:29:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:04.660 19:29:51 -- common/autotest_common.sh@10 -- # set +x 00:23:04.660 ************************************ 00:23:04.660 START TEST nvmf_target_disconnect_tc3 00:23:04.660 ************************************ 00:23:04.660 19:29:51 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:23:04.660 19:29:51 -- host/target_disconnect.sh@65 -- # reconnectpid=3118471 00:23:04.660 19:29:51 -- host/target_disconnect.sh@67 -- # sleep 2 00:23:04.660 19:29:51 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:23:04.918 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.817 19:29:53 -- host/target_disconnect.sh@68 -- # kill -9 3117511 00:23:06.817 19:29:53 -- host/target_disconnect.sh@70 -- # sleep 2 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Read completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 Write completed with error (sct=0, sc=8) 00:23:08.196 starting I/O failed 00:23:08.196 [2024-04-24 19:29:54.815486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:08.764 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 3117511 Killed "${NVMF_APP[@]}" "$@" 00:23:08.764 19:29:55 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:23:08.764 19:29:55 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:23:08.764 19:29:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:08.764 19:29:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:08.764 19:29:55 -- common/autotest_common.sh@10 -- # set +x 00:23:08.764 19:29:55 -- nvmf/common.sh@470 -- # nvmfpid=3119020 00:23:08.764 19:29:55 -- nvmf/common.sh@471 -- # waitforlisten 3119020 00:23:08.764 19:29:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:23:08.764 19:29:55 -- common/autotest_common.sh@817 -- # '[' -z 3119020 ']' 00:23:08.764 19:29:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:08.764 19:29:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:08.764 19:29:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:08.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:08.764 19:29:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:08.764 19:29:55 -- common/autotest_common.sh@10 -- # set +x 00:23:08.764 [2024-04-24 19:29:55.692727] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:23:08.764 [2024-04-24 19:29:55.692787] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:08.764 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.764 [2024-04-24 19:29:55.778434] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Write completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 Read completed with error (sct=0, sc=8) 00:23:09.024 starting I/O failed 00:23:09.024 [2024-04-24 19:29:55.820815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:09.024 [2024-04-24 19:29:55.859176] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.024 [2024-04-24 19:29:55.859221] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.024 [2024-04-24 19:29:55.859231] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:09.024 [2024-04-24 19:29:55.859240] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:09.024 [2024-04-24 19:29:55.859248] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.024 [2024-04-24 19:29:55.859358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:23:09.024 [2024-04-24 19:29:55.859411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:23:09.024 [2024-04-24 19:29:55.859508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:09.024 [2024-04-24 19:29:55.859509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:23:09.590 19:29:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:09.590 19:29:56 -- common/autotest_common.sh@850 -- # return 0 00:23:09.590 19:29:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:09.590 19:29:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:09.590 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.590 19:29:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:09.590 19:29:56 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:09.590 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.590 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.590 Malloc0 00:23:09.590 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.590 19:29:56 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:23:09.590 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.590 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.591 [2024-04-24 19:29:56.607366] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x77c1e0/0x787f40) succeed. 00:23:09.849 [2024-04-24 19:29:56.618377] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x77d820/0x828040) succeed. 00:23:09.849 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.849 19:29:56 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:09.849 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.849 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.849 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.849 19:29:56 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:09.849 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.849 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.849 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.849 19:29:56 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:23:09.849 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.849 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.849 [2024-04-24 19:29:56.763728] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:09.849 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.849 19:29:56 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:23:09.849 19:29:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:09.849 19:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:09.849 19:29:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:09.849 19:29:56 -- host/target_disconnect.sh@73 -- # wait 3118471 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Write completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.849 Read completed with error (sct=0, sc=8) 00:23:09.849 starting I/O failed 00:23:09.850 [2024-04-24 19:29:56.825698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.850 [2024-04-24 19:29:56.827150] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:09.850 [2024-04-24 19:29:56.827171] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:09.850 [2024-04-24 19:29:56.827180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.225 [2024-04-24 19:29:57.830989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.225 qpair failed and we were unable to recover it. 00:23:11.225 [2024-04-24 19:29:57.832338] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:11.225 [2024-04-24 19:29:57.832356] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:11.225 [2024-04-24 19:29:57.832364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.158 [2024-04-24 19:29:58.836061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.158 qpair failed and we were unable to recover it. 00:23:12.158 [2024-04-24 19:29:58.837380] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:12.158 [2024-04-24 19:29:58.837397] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:12.158 [2024-04-24 19:29:58.837405] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.092 [2024-04-24 19:29:59.841144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.092 qpair failed and we were unable to recover it. 00:23:13.092 [2024-04-24 19:29:59.842385] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:13.092 [2024-04-24 19:29:59.842402] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:13.092 [2024-04-24 19:29:59.842410] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:14.027 [2024-04-24 19:30:00.846194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:14.027 qpair failed and we were unable to recover it. 00:23:14.027 [2024-04-24 19:30:00.847592] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:14.027 [2024-04-24 19:30:00.847611] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:14.027 [2024-04-24 19:30:00.847619] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:14.960 [2024-04-24 19:30:01.851497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:14.960 qpair failed and we were unable to recover it. 00:23:14.960 [2024-04-24 19:30:01.852867] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:14.960 [2024-04-24 19:30:01.852885] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:14.960 [2024-04-24 19:30:01.852893] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:15.893 [2024-04-24 19:30:02.856784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:15.893 qpair failed and we were unable to recover it. 00:23:15.893 [2024-04-24 19:30:02.858064] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:15.893 [2024-04-24 19:30:02.858080] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:15.893 [2024-04-24 19:30:02.858088] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:17.268 [2024-04-24 19:30:03.861769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:17.268 qpair failed and we were unable to recover it. 00:23:17.268 [2024-04-24 19:30:03.863314] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:17.268 [2024-04-24 19:30:03.863346] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:17.268 [2024-04-24 19:30:03.863360] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:18.202 [2024-04-24 19:30:04.867079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:18.202 qpair failed and we were unable to recover it. 00:23:18.202 [2024-04-24 19:30:04.868479] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:18.202 [2024-04-24 19:30:04.868497] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:18.202 [2024-04-24 19:30:04.868505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:19.135 [2024-04-24 19:30:05.872363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:19.135 qpair failed and we were unable to recover it. 00:23:19.135 [2024-04-24 19:30:05.872502] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:23:19.135 A controller has encountered a failure and is being reset. 00:23:19.135 Resorting to new failover address 192.168.100.9 00:23:19.135 [2024-04-24 19:30:05.874082] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:19.135 [2024-04-24 19:30:05.874112] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:19.135 [2024-04-24 19:30:05.874126] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:23:20.067 [2024-04-24 19:30:06.877831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:20.067 qpair failed and we were unable to recover it. 00:23:20.067 [2024-04-24 19:30:06.879057] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:20.067 [2024-04-24 19:30:06.879074] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:20.067 [2024-04-24 19:30:06.879082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:23:20.999 [2024-04-24 19:30:07.882868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:20.999 qpair failed and we were unable to recover it. 00:23:20.999 [2024-04-24 19:30:07.882977] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Write completed with error (sct=0, sc=8) 00:23:21.933 starting I/O failed 00:23:21.933 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Write completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Write completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Write completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Write completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Write completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 Read completed with error (sct=0, sc=8) 00:23:21.934 starting I/O failed 00:23:21.934 [2024-04-24 19:30:08.888001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:21.934 [2024-04-24 19:30:08.888118] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:23:21.934 [2024-04-24 19:30:08.919025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:21.934 Controller properly reset. 00:23:22.192 Initializing NVMe Controllers 00:23:22.192 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:22.192 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:22.192 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:23:22.192 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:23:22.192 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:23:22.192 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:23:22.192 Initialization complete. Launching workers. 00:23:22.192 Starting thread on core 1 00:23:22.192 Starting thread on core 2 00:23:22.192 Starting thread on core 3 00:23:22.192 Starting thread on core 0 00:23:22.192 19:30:08 -- host/target_disconnect.sh@74 -- # sync 00:23:22.192 00:23:22.192 real 0m17.346s 00:23:22.192 user 0m55.202s 00:23:22.192 sys 0m5.963s 00:23:22.192 19:30:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:22.192 19:30:08 -- common/autotest_common.sh@10 -- # set +x 00:23:22.192 ************************************ 00:23:22.192 END TEST nvmf_target_disconnect_tc3 00:23:22.192 ************************************ 00:23:22.192 19:30:09 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:23:22.192 19:30:09 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:23:22.192 19:30:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:22.192 19:30:09 -- nvmf/common.sh@117 -- # sync 00:23:22.192 19:30:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:22.192 19:30:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:22.192 19:30:09 -- nvmf/common.sh@120 -- # set +e 00:23:22.192 19:30:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:22.192 19:30:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:22.192 rmmod nvme_rdma 00:23:22.192 rmmod nvme_fabrics 00:23:22.192 19:30:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:22.192 19:30:09 -- nvmf/common.sh@124 -- # set -e 00:23:22.192 19:30:09 -- nvmf/common.sh@125 -- # return 0 00:23:22.192 19:30:09 -- nvmf/common.sh@478 -- # '[' -n 3119020 ']' 00:23:22.192 19:30:09 -- nvmf/common.sh@479 -- # killprocess 3119020 00:23:22.192 19:30:09 -- common/autotest_common.sh@936 -- # '[' -z 3119020 ']' 00:23:22.192 19:30:09 -- common/autotest_common.sh@940 -- # kill -0 3119020 00:23:22.192 19:30:09 -- common/autotest_common.sh@941 -- # uname 00:23:22.192 19:30:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:22.193 19:30:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3119020 00:23:22.193 19:30:09 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:23:22.193 19:30:09 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:23:22.193 19:30:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3119020' 00:23:22.193 killing process with pid 3119020 00:23:22.193 19:30:09 -- common/autotest_common.sh@955 -- # kill 3119020 00:23:22.193 19:30:09 -- common/autotest_common.sh@960 -- # wait 3119020 00:23:22.193 [2024-04-24 19:30:09.207145] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:22.452 19:30:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:22.452 19:30:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:22.452 00:23:22.452 real 0m38.300s 00:23:22.452 user 2m18.599s 00:23:22.452 sys 0m14.943s 00:23:22.452 19:30:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:22.452 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.452 ************************************ 00:23:22.452 END TEST nvmf_target_disconnect 00:23:22.452 ************************************ 00:23:22.711 19:30:09 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:23:22.711 19:30:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:22.711 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.711 19:30:09 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:23:22.711 00:23:22.711 real 16m12.749s 00:23:22.711 user 40m48.727s 00:23:22.711 sys 4m40.285s 00:23:22.711 19:30:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:22.711 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.711 ************************************ 00:23:22.711 END TEST nvmf_rdma 00:23:22.711 ************************************ 00:23:22.711 19:30:09 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:23:22.711 19:30:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:22.711 19:30:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:22.711 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.711 ************************************ 00:23:22.711 START TEST spdkcli_nvmf_rdma 00:23:22.711 ************************************ 00:23:22.711 19:30:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:23:22.971 * Looking for test storage... 00:23:22.971 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:23:22.971 19:30:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:23:22.971 19:30:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:22.971 19:30:09 -- nvmf/common.sh@7 -- # uname -s 00:23:22.971 19:30:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:22.971 19:30:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:22.971 19:30:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:22.971 19:30:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:22.971 19:30:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:22.971 19:30:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:22.971 19:30:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:22.971 19:30:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:22.971 19:30:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:22.971 19:30:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:22.971 19:30:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:008e7f2e-322d-e711-906e-0017a4403562 00:23:22.971 19:30:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=008e7f2e-322d-e711-906e-0017a4403562 00:23:22.971 19:30:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:22.971 19:30:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:22.971 19:30:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:22.971 19:30:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:22.971 19:30:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:22.971 19:30:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:22.971 19:30:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:22.971 19:30:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:22.971 19:30:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.971 19:30:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.971 19:30:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.971 19:30:09 -- paths/export.sh@5 -- # export PATH 00:23:22.971 19:30:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:22.971 19:30:09 -- nvmf/common.sh@47 -- # : 0 00:23:22.971 19:30:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:22.971 19:30:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:22.971 19:30:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:22.971 19:30:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:22.971 19:30:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:22.971 19:30:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:22.971 19:30:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:22.971 19:30:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:23:22.971 19:30:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:22.971 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.971 19:30:09 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:23:22.971 19:30:09 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3121448 00:23:22.971 19:30:09 -- spdkcli/common.sh@34 -- # waitforlisten 3121448 00:23:22.971 19:30:09 -- common/autotest_common.sh@817 -- # '[' -z 3121448 ']' 00:23:22.971 19:30:09 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:23:22.971 19:30:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:22.971 19:30:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:22.971 19:30:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:22.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:22.971 19:30:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:22.971 19:30:09 -- common/autotest_common.sh@10 -- # set +x 00:23:22.971 [2024-04-24 19:30:09.881177] Starting SPDK v24.05-pre git sha1 5c8d451f1 / DPDK 23.11.0 initialization... 00:23:22.971 [2024-04-24 19:30:09.881237] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3121448 ] 00:23:22.971 EAL: No free 2048 kB hugepages reported on node 1 00:23:22.971 [2024-04-24 19:30:09.951089] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:23:23.230 [2024-04-24 19:30:10.046730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:23.230 [2024-04-24 19:30:10.046733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:23.798 19:30:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:23.798 19:30:10 -- common/autotest_common.sh@850 -- # return 0 00:23:23.798 19:30:10 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:23:23.798 19:30:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:23.798 19:30:10 -- common/autotest_common.sh@10 -- # set +x 00:23:23.798 19:30:10 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:23:23.798 19:30:10 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:23:23.798 19:30:10 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:23:23.798 19:30:10 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:23.798 19:30:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:23.798 19:30:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:23.798 19:30:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:23.798 19:30:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:23.798 19:30:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.798 19:30:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:23:23.798 19:30:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.798 19:30:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:23.798 19:30:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:23.798 19:30:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:23.798 19:30:10 -- common/autotest_common.sh@10 -- # set +x 00:23:30.364 19:30:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:30.364 19:30:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:30.364 19:30:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:30.364 19:30:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:30.364 19:30:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:30.364 19:30:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:30.364 19:30:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:30.364 19:30:17 -- nvmf/common.sh@295 -- # net_devs=() 00:23:30.364 19:30:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:30.364 19:30:17 -- nvmf/common.sh@296 -- # e810=() 00:23:30.364 19:30:17 -- nvmf/common.sh@296 -- # local -ga e810 00:23:30.364 19:30:17 -- nvmf/common.sh@297 -- # x722=() 00:23:30.364 19:30:17 -- nvmf/common.sh@297 -- # local -ga x722 00:23:30.364 19:30:17 -- nvmf/common.sh@298 -- # mlx=() 00:23:30.364 19:30:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:30.364 19:30:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:30.364 19:30:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:30.364 19:30:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:30.364 19:30:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:23:30.364 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:23:30.364 19:30:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:30.364 19:30:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:30.364 19:30:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:23:30.364 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:23:30.364 19:30:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:30.364 19:30:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:30.364 19:30:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:30.364 19:30:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:30.364 19:30:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:30.364 19:30:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:30.364 19:30:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:23:30.364 Found net devices under 0000:18:00.0: mlx_0_0 00:23:30.364 19:30:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:30.364 19:30:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:30.364 19:30:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:30.364 19:30:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:30.364 19:30:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:23:30.364 Found net devices under 0000:18:00.1: mlx_0_1 00:23:30.364 19:30:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:30.364 19:30:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:30.364 19:30:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:30.364 19:30:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:30.364 19:30:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:30.365 19:30:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:30.365 19:30:17 -- nvmf/common.sh@58 -- # uname 00:23:30.365 19:30:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:30.365 19:30:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:30.365 19:30:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:30.365 19:30:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:30.365 19:30:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:30.365 19:30:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:30.365 19:30:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:30.365 19:30:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:30.365 19:30:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:30.365 19:30:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:30.365 19:30:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:30.365 19:30:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:30.365 19:30:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:30.365 19:30:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:30.365 19:30:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:30.365 19:30:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:30.365 19:30:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@105 -- # continue 2 00:23:30.365 19:30:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@105 -- # continue 2 00:23:30.365 19:30:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:30.365 19:30:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:30.365 19:30:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:30.365 19:30:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:30.365 99: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:30.365 link/ether 50:6b:4b:38:8b:36 brd ff:ff:ff:ff:ff:ff 00:23:30.365 altname enp24s0f0np0 00:23:30.365 altname ens785f0np0 00:23:30.365 inet 192.168.100.8/24 scope global mlx_0_0 00:23:30.365 valid_lft forever preferred_lft forever 00:23:30.365 19:30:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:30.365 19:30:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:30.365 19:30:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:30.365 19:30:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:30.365 100: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:30.365 link/ether 50:6b:4b:38:8b:37 brd ff:ff:ff:ff:ff:ff 00:23:30.365 altname enp24s0f1np1 00:23:30.365 altname ens785f1np1 00:23:30.365 inet 192.168.100.9/24 scope global mlx_0_1 00:23:30.365 valid_lft forever preferred_lft forever 00:23:30.365 19:30:17 -- nvmf/common.sh@411 -- # return 0 00:23:30.365 19:30:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:30.365 19:30:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:30.365 19:30:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:30.365 19:30:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:30.365 19:30:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:30.365 19:30:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:30.365 19:30:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:30.365 19:30:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:30.365 19:30:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:30.365 19:30:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@105 -- # continue 2 00:23:30.365 19:30:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:30.365 19:30:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:30.365 19:30:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@105 -- # continue 2 00:23:30.365 19:30:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:30.365 19:30:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:30.365 19:30:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:30.365 19:30:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:30.365 19:30:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:30.365 19:30:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:30.365 192.168.100.9' 00:23:30.365 19:30:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:30.365 192.168.100.9' 00:23:30.365 19:30:17 -- nvmf/common.sh@446 -- # head -n 1 00:23:30.365 19:30:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:30.365 19:30:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:30.365 192.168.100.9' 00:23:30.365 19:30:17 -- nvmf/common.sh@447 -- # tail -n +2 00:23:30.365 19:30:17 -- nvmf/common.sh@447 -- # head -n 1 00:23:30.365 19:30:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:30.365 19:30:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:30.365 19:30:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:30.365 19:30:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:30.365 19:30:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:30.365 19:30:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:30.365 19:30:17 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:23:30.365 19:30:17 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:23:30.365 19:30:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:30.365 19:30:17 -- common/autotest_common.sh@10 -- # set +x 00:23:30.365 19:30:17 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:23:30.365 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:23:30.365 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:23:30.365 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:23:30.365 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:23:30.365 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:23:30.365 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:23:30.365 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:30.365 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:30.365 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:23:30.365 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:23:30.365 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:23:30.365 ' 00:23:30.626 [2024-04-24 19:30:17.637246] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:33.161 [2024-04-24 19:30:19.754325] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x5acbc0/0x6dcd80) succeed. 00:23:33.161 [2024-04-24 19:30:19.766103] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x5ae2a0/0x5bcc80) succeed. 00:23:34.097 [2024-04-24 19:30:21.028882] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:23:36.694 [2024-04-24 19:30:23.259919] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:23:38.599 [2024-04-24 19:30:25.178221] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:23:39.989 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:23:39.989 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:23:39.989 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:39.989 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:39.989 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:39.989 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:23:39.990 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:23:39.990 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:23:39.990 19:30:26 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:23:39.990 19:30:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:39.990 19:30:26 -- common/autotest_common.sh@10 -- # set +x 00:23:39.990 19:30:26 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:23:39.990 19:30:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:39.990 19:30:26 -- common/autotest_common.sh@10 -- # set +x 00:23:39.990 19:30:26 -- spdkcli/nvmf.sh@69 -- # check_match 00:23:39.990 19:30:26 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:23:40.249 19:30:27 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:23:40.249 19:30:27 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:23:40.250 19:30:27 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:23:40.250 19:30:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:40.250 19:30:27 -- common/autotest_common.sh@10 -- # set +x 00:23:40.250 19:30:27 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:23:40.250 19:30:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:40.250 19:30:27 -- common/autotest_common.sh@10 -- # set +x 00:23:40.507 19:30:27 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:23:40.507 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:23:40.507 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:23:40.507 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:23:40.507 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:23:40.507 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:23:40.508 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:23:40.508 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:23:40.508 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:23:40.508 ' 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:23:45.780 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:23:45.780 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:23:45.780 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:23:45.780 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:23:45.780 19:30:32 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:23:45.780 19:30:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:45.780 19:30:32 -- common/autotest_common.sh@10 -- # set +x 00:23:45.780 19:30:32 -- spdkcli/nvmf.sh@90 -- # killprocess 3121448 00:23:45.780 19:30:32 -- common/autotest_common.sh@936 -- # '[' -z 3121448 ']' 00:23:45.780 19:30:32 -- common/autotest_common.sh@940 -- # kill -0 3121448 00:23:45.780 19:30:32 -- common/autotest_common.sh@941 -- # uname 00:23:45.780 19:30:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:45.780 19:30:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3121448 00:23:45.780 19:30:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:45.780 19:30:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:45.780 19:30:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3121448' 00:23:45.780 killing process with pid 3121448 00:23:45.780 19:30:32 -- common/autotest_common.sh@955 -- # kill 3121448 00:23:45.780 [2024-04-24 19:30:32.328855] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:45.780 19:30:32 -- common/autotest_common.sh@960 -- # wait 3121448 00:23:45.780 [2024-04-24 19:30:32.384710] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:45.780 19:30:32 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:23:45.780 19:30:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:45.780 19:30:32 -- nvmf/common.sh@117 -- # sync 00:23:45.780 19:30:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:45.780 19:30:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:45.780 19:30:32 -- nvmf/common.sh@120 -- # set +e 00:23:45.780 19:30:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:45.780 19:30:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:45.780 rmmod nvme_rdma 00:23:45.780 rmmod nvme_fabrics 00:23:45.780 19:30:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:45.780 19:30:32 -- nvmf/common.sh@124 -- # set -e 00:23:45.780 19:30:32 -- nvmf/common.sh@125 -- # return 0 00:23:45.780 19:30:32 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:23:45.780 19:30:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:45.780 19:30:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:45.780 00:23:45.780 real 0m22.970s 00:23:45.780 user 0m48.880s 00:23:45.780 sys 0m5.850s 00:23:45.780 19:30:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:45.780 19:30:32 -- common/autotest_common.sh@10 -- # set +x 00:23:45.780 ************************************ 00:23:45.780 END TEST spdkcli_nvmf_rdma 00:23:45.780 ************************************ 00:23:45.780 19:30:32 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:23:45.780 19:30:32 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:23:45.780 19:30:32 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:23:45.780 19:30:32 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:23:45.780 19:30:32 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:23:45.780 19:30:32 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:23:45.781 19:30:32 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:23:45.781 19:30:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:45.781 19:30:32 -- common/autotest_common.sh@10 -- # set +x 00:23:45.781 19:30:32 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:23:45.781 19:30:32 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:23:45.781 19:30:32 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:23:45.781 19:30:32 -- common/autotest_common.sh@10 -- # set +x 00:23:51.069 INFO: APP EXITING 00:23:51.069 INFO: killing all VMs 00:23:51.069 INFO: killing vhost app 00:23:51.069 WARN: no vhost pid file found 00:23:51.069 INFO: EXIT DONE 00:23:53.607 Waiting for block devices as requested 00:23:53.607 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:23:53.607 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:53.607 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:53.607 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:53.607 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:53.607 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:53.866 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:53.866 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:53.866 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:23:54.127 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:54.127 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:54.127 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:54.387 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:54.387 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:54.387 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:54.644 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:54.644 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:23:57.924 Cleaning 00:23:57.924 Removing: /var/run/dpdk/spdk0/config 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:23:57.924 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:23:57.924 Removing: /var/run/dpdk/spdk0/hugepage_info 00:23:57.924 Removing: /var/run/dpdk/spdk1/config 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:23:57.924 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:23:57.924 Removing: /var/run/dpdk/spdk1/hugepage_info 00:23:57.924 Removing: /var/run/dpdk/spdk1/mp_socket 00:23:57.924 Removing: /var/run/dpdk/spdk2/config 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:23:57.924 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:23:57.924 Removing: /var/run/dpdk/spdk2/hugepage_info 00:23:57.924 Removing: /var/run/dpdk/spdk3/config 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:23:57.924 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:23:57.924 Removing: /var/run/dpdk/spdk3/hugepage_info 00:23:57.924 Removing: /var/run/dpdk/spdk4/config 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:23:57.924 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:23:57.924 Removing: /var/run/dpdk/spdk4/hugepage_info 00:23:57.924 Removing: /dev/shm/bdevperf_trace.pid2975693 00:23:57.924 Removing: /dev/shm/bdevperf_trace.pid3056829 00:23:57.924 Removing: /dev/shm/bdev_svc_trace.1 00:23:57.924 Removing: /dev/shm/nvmf_trace.0 00:23:57.924 Removing: /dev/shm/spdk_tgt_trace.pid2879391 00:23:58.183 Removing: /var/run/dpdk/spdk0 00:23:58.183 Removing: /var/run/dpdk/spdk1 00:23:58.183 Removing: /var/run/dpdk/spdk2 00:23:58.183 Removing: /var/run/dpdk/spdk3 00:23:58.183 Removing: /var/run/dpdk/spdk4 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2877116 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2878132 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2879391 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2879978 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2880751 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2880978 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2881895 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2881948 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2882323 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2887028 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2888245 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2888595 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2888844 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2889110 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2889533 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2889753 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2889957 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2890200 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2890997 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2893592 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2893809 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2894127 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2894222 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2894659 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2894812 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2895394 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2895408 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2895795 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2895815 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2896032 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2896212 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2896691 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2896904 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2897157 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2897460 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2897592 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2897832 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2898059 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2898271 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2898482 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2898696 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2898966 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2899281 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2899487 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2899705 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2899911 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2900128 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2900415 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2900712 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2900923 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2901132 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2901346 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2901555 00:23:58.183 Removing: /var/run/dpdk/spdk_pid2901847 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2902142 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2902356 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2902572 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2902808 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2903086 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2906521 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2943306 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2946788 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2954326 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2958724 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2961841 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2962555 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2975693 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2975895 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2979573 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2984533 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2986667 00:23:58.441 Removing: /var/run/dpdk/spdk_pid2995296 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3016456 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3019695 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3032258 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3055036 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3055923 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3056829 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3060413 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3066631 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3067359 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3068085 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3068808 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3069173 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3072928 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3073003 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3076867 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3077239 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3077768 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3078318 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3078323 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3082844 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3083292 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3086855 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3089048 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3095036 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3095039 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3111374 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3111624 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3116557 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3116959 00:23:58.441 Removing: /var/run/dpdk/spdk_pid3118471 00:23:58.442 Removing: /var/run/dpdk/spdk_pid3121448 00:23:58.442 Clean 00:23:58.701 19:30:45 -- common/autotest_common.sh@1437 -- # return 0 00:23:58.701 19:30:45 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:23:58.701 19:30:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:58.701 19:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:58.701 19:30:45 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:23:58.701 19:30:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:58.701 19:30:45 -- common/autotest_common.sh@10 -- # set +x 00:23:58.701 19:30:45 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:23:58.701 19:30:45 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:23:58.701 19:30:45 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:23:58.960 19:30:45 -- spdk/autotest.sh@389 -- # hash lcov 00:23:58.960 19:30:45 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:23:58.960 19:30:45 -- spdk/autotest.sh@391 -- # hostname 00:23:58.960 19:30:45 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-35 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:23:58.960 geninfo: WARNING: invalid characters removed from testname! 00:24:20.893 19:31:04 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:20.893 19:31:07 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:22.274 19:31:08 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:23.653 19:31:10 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:25.558 19:31:12 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:27.012 19:31:13 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:28.918 19:31:15 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:24:28.918 19:31:15 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:24:28.918 19:31:15 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:24:28.918 19:31:15 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:28.918 19:31:15 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:28.918 19:31:15 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.918 19:31:15 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.918 19:31:15 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.918 19:31:15 -- paths/export.sh@5 -- $ export PATH 00:24:28.918 19:31:15 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.918 19:31:15 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:24:28.918 19:31:15 -- common/autobuild_common.sh@435 -- $ date +%s 00:24:28.918 19:31:15 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713979875.XXXXXX 00:24:28.918 19:31:15 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713979875.QKBMbP 00:24:28.918 19:31:15 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:24:28.918 19:31:15 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:24:28.918 19:31:15 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:24:28.918 19:31:15 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:24:28.918 19:31:15 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:24:28.918 19:31:15 -- common/autobuild_common.sh@451 -- $ get_config_params 00:24:28.918 19:31:15 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:24:28.918 19:31:15 -- common/autotest_common.sh@10 -- $ set +x 00:24:28.918 19:31:15 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:24:28.918 19:31:15 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:24:28.918 19:31:15 -- pm/common@17 -- $ local monitor 00:24:28.918 19:31:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:28.918 19:31:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3134384 00:24:28.918 19:31:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:28.918 19:31:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3134386 00:24:28.918 19:31:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:28.918 19:31:15 -- pm/common@21 -- $ date +%s 00:24:28.918 19:31:15 -- pm/common@21 -- $ date +%s 00:24:28.918 19:31:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3134388 00:24:28.918 19:31:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:28.918 19:31:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3134392 00:24:28.918 19:31:15 -- pm/common@21 -- $ date +%s 00:24:28.918 19:31:15 -- pm/common@26 -- $ sleep 1 00:24:28.918 19:31:15 -- pm/common@21 -- $ date +%s 00:24:28.918 19:31:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713979875 00:24:28.918 19:31:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713979875 00:24:28.918 19:31:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713979875 00:24:28.918 19:31:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713979875 00:24:28.918 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713979875_collect-vmstat.pm.log 00:24:28.918 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713979875_collect-cpu-load.pm.log 00:24:28.919 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713979875_collect-bmc-pm.bmc.pm.log 00:24:28.919 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713979875_collect-cpu-temp.pm.log 00:24:29.857 19:31:16 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:24:29.857 19:31:16 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j72 00:24:29.857 19:31:16 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:29.857 19:31:16 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:24:29.857 19:31:16 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:24:29.857 19:31:16 -- spdk/autopackage.sh@19 -- $ timing_finish 00:24:29.857 19:31:16 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:24:29.857 19:31:16 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:24:29.857 19:31:16 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:24:29.857 19:31:16 -- spdk/autopackage.sh@20 -- $ exit 0 00:24:29.857 19:31:16 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:24:29.857 19:31:16 -- pm/common@30 -- $ signal_monitor_resources TERM 00:24:29.857 19:31:16 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:24:29.857 19:31:16 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:29.857 19:31:16 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:24:29.857 19:31:16 -- pm/common@45 -- $ pid=3134400 00:24:29.857 19:31:16 -- pm/common@52 -- $ sudo kill -TERM 3134400 00:24:29.857 19:31:16 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:29.857 19:31:16 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:24:29.857 19:31:16 -- pm/common@45 -- $ pid=3134399 00:24:29.857 19:31:16 -- pm/common@52 -- $ sudo kill -TERM 3134399 00:24:29.857 19:31:16 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:29.857 19:31:16 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:24:29.857 19:31:16 -- pm/common@45 -- $ pid=3134401 00:24:29.857 19:31:16 -- pm/common@52 -- $ sudo kill -TERM 3134401 00:24:29.857 19:31:16 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:29.857 19:31:16 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:24:29.857 19:31:16 -- pm/common@45 -- $ pid=3134402 00:24:29.857 19:31:16 -- pm/common@52 -- $ sudo kill -TERM 3134402 00:24:29.857 + [[ -n 2779170 ]] 00:24:29.857 + sudo kill 2779170 00:24:29.866 [Pipeline] } 00:24:29.883 [Pipeline] // stage 00:24:29.887 [Pipeline] } 00:24:29.905 [Pipeline] // timeout 00:24:29.910 [Pipeline] } 00:24:29.924 [Pipeline] // catchError 00:24:29.928 [Pipeline] } 00:24:29.944 [Pipeline] // wrap 00:24:29.950 [Pipeline] } 00:24:29.965 [Pipeline] // catchError 00:24:29.973 [Pipeline] stage 00:24:29.975 [Pipeline] { (Epilogue) 00:24:29.988 [Pipeline] catchError 00:24:29.990 [Pipeline] { 00:24:30.004 [Pipeline] echo 00:24:30.006 Cleanup processes 00:24:30.011 [Pipeline] sh 00:24:30.294 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:30.294 3134500 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:24:30.294 3134733 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:30.307 [Pipeline] sh 00:24:30.590 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:30.590 ++ grep -v 'sudo pgrep' 00:24:30.590 ++ awk '{print $1}' 00:24:30.590 + sudo kill -9 3134500 00:24:30.601 [Pipeline] sh 00:24:30.884 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:24:37.469 [Pipeline] sh 00:24:37.755 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:24:37.755 Artifacts sizes are good 00:24:37.770 [Pipeline] archiveArtifacts 00:24:37.778 Archiving artifacts 00:24:37.904 [Pipeline] sh 00:24:38.189 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:24:38.205 [Pipeline] cleanWs 00:24:38.215 [WS-CLEANUP] Deleting project workspace... 00:24:38.215 [WS-CLEANUP] Deferred wipeout is used... 00:24:38.222 [WS-CLEANUP] done 00:24:38.224 [Pipeline] } 00:24:38.243 [Pipeline] // catchError 00:24:38.255 [Pipeline] sh 00:24:38.570 + logger -p user.info -t JENKINS-CI 00:24:38.579 [Pipeline] } 00:24:38.594 [Pipeline] // stage 00:24:38.599 [Pipeline] } 00:24:38.615 [Pipeline] // node 00:24:38.620 [Pipeline] End of Pipeline 00:24:38.937 Finished: SUCCESS